Senior Software Engineer

Microsoft's AI Frameworks team is at the forefront of developing AI software that enables running AI models across various platforms, from supercomputers to mobile devices. The team works on OpenAI and other state-of-the-art large language models (LLMs), serving trillions of inferences daily in major Microsoft products including Office, Windows, Bing, SQL Server, and Dynamics.

As a Senior Software Engineer, you'll work on multiple levels of the AI software stack, including fundamental abstractions, programming models, compilers, runtimes, libraries, and APIs. You'll be responsible for benchmarking and optimizing LLM performance on GPUs and Microsoft hardware, helping achieve Azure's capex goals through efficient model deployment.

The role requires strong technical expertise in software engineering, computer architecture, and GPU optimization. You'll collaborate with internal and external partners, including OpenAI, while working in a highly capable and inclusive team environment. The position offers competitive compensation ($119,800 - $234,700 base salary range, higher in SF/NYC areas) and comprehensive benefits.

This is an opportunity to impact the future of AI infrastructure at scale, working with cutting-edge technology and some of the largest AI workloads globally. The role combines hands-on technical work with strategic thinking about performance optimization and system efficiency.