Senior Software Engineer

The Artificial Intelligence Performance team at Microsoft develops AI software that enables running AI models everywhere, from world's fastest AI supercomputers, to servers, desktops, mobile phones, IoT devices and internet browsers. The team collaborates with hardware teams and partners, operating at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software.

The role involves working on OpenAI and other state-of-the-art LLM models, directly collaborating with OpenAI on models hosted on the Azure OpenAI service. These models serve some of the largest workloads on the planet with trillions of inferences per day in major Microsoft products, including Office, Windows, Bing, SQL Server, and Dynamics.

As a Senior Software Engineer, you will:

• Work on multiple levels of the AI software stack
• Benchmark and optimize OpenAI and other LLM models for performance on GPUs and Microsoft HW
• Debug and monitor performance
• Enable rapid model deployment while minimizing hardware requirements
• Build software tools for performance insights
• Collaborate with internal and external partners

The role requires strong software design and development skills, with an entrepreneurial approach and ability to take initiative. The team prides itself on a collaborative and inclusive culture, working at the cutting edge of AI technology.

The position offers comprehensive benefits including industry-leading healthcare, educational resources, savings and investments, parental leave, generous time off, and opportunities for professional growth and networking.

This is an opportunity to work on critical AI infrastructure that powers major Microsoft products and services, with direct impact on the company's AI capabilities and efficiency goals.