Taro Logo

Software Engineer II (GPU Performance)

Microsoft develops software and technology solutions, empowering every person and organization on the planet to achieve more.
$98,300 - $193,200
Machine Learning
Mid-Level Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Software Engineer II (GPU Performance)

Microsoft's AI Frameworks team is seeking a Software Engineer II specializing in GPU Performance to join their cutting-edge work on AI software development. This role is part of the team that develops AI software for training and deploying advanced AI models, working directly with OpenAI and contributing to Microsoft's next-generation supercomputers and Maia-100 AI accelerator.

The position focuses on GPU performance analysis and optimization, requiring strong technical expertise in C/C++, CUDA, and related technologies. You'll be working on fundamental abstractions, programming models, runtimes, libraries, and APIs to enable large-scale training and inferencing of models on novel AI hardware. The role offers an opportunity to work with state-of-the-art technology and directly impact the performance of machine learning models.

As part of Microsoft's commitment to innovation and inclusion, you'll join a collaborative environment that values different perspectives and approaches to problem-solving. The position offers competitive compensation ($98,300 - $193,200) and comprehensive benefits, including healthcare, educational resources, and parental leave. The hybrid work arrangement (up to 50% work from home) provides flexibility while maintaining team collaboration.

This is an excellent opportunity for someone with a proven track record in GPU optimization and machine learning frameworks who wants to work at the forefront of AI technology development. The role combines technical challenges with the opportunity to impact the future of AI infrastructure at one of the world's leading technology companies.

Last updated 3 months ago

Responsibilities For Software Engineer II (GPU Performance)

  • Software development in C/C++, Python, and GPU languages such as CUDA, ROCm, or Triton
  • Work with cutting-edge hardware stacks and fast-moving software stack to deliver best-of-class inference and optimal cost
  • Engage with key partners to implement performance analysis and optimization for state-of-the-art LLMs and other models
  • Embody Microsoft's culture and values

Requirements For Software Engineer II (GPU Performance)

Python
Kubernetes
  • Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in C/C++, CUDA, or ROCm
  • 1+ years practical experience working on GPU applications and optimization
  • Experience in low-level performance analysis and optimization
  • Proficiency using GPU profiling tools such as NVIDIA Visual Profiler and NVIDIA Nsight Compute
  • Technical background in software engineering principles and architecture design
  • Experience with Deep Neural Network inference and deep learning frameworks

Benefits For Software Engineer II (GPU Performance)

Medical Insurance
Education Budget
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?