Principal Software Engineer

Microsoft's Artificial Intelligence Performance team is seeking a Principal Software Engineer to join their cutting-edge work on AI software development. This role sits at the intersection of AI innovation and hardware optimization, working directly with OpenAI and handling some of the largest workloads on Azure OpenAI service.

The position involves developing AI software that enables running AI models across a spectrum of platforms - from world-class AI supercomputers to mobile devices and browsers. You'll be working on the inference performance of OpenAI and other state-of-the-art LLM models, serving trillions of inferences daily for major Microsoft products including Office, Windows, Bing, SQL Server, and Dynamics.

As a Principal Software Engineer, you'll have the opportunity to work across multiple levels of the AI software stack, including fundamental abstractions, programming models, compilers, runtimes, libraries, and APIs. Your work will directly impact the efficiency and performance of large-scale AI model training and inferencing.

The role requires exceptional software design and development skills, with a focus on performance optimization and debugging. You'll be benchmarking OpenAI and other LLM models for performance on GPUs and Microsoft hardware, working to deploy these models with optimal efficiency to help achieve Microsoft Azure's capex goals.

This is an ideal opportunity for someone who thrives on solving complex technical challenges and wants to work at the forefront of AI technology. The position offers competitive compensation ($188,000 - $304,200 for SF Bay area), comprehensive benefits, and the chance to work with world-class teams and technologies.

The role can be based in the SF Bay Area or Redmond, with remote options available for strong candidates. You'll be joining a collaborative and inclusive culture that values growth mindset and innovation, working on projects that directly impact Microsoft's mission to empower every person and organization on the planet to achieve more.

Benefits include industry-leading healthcare, educational resources, investment options, parental leave, generous time off, and opportunities for professional growth and networking. Microsoft is committed to diversity and inclusion, offering equal opportunities to all qualified applicants regardless of background.