Software Engineer II

Microsoft is seeking a Software Engineer II to join their Azure AI Platform team, specifically the Model Scaling Platform team. This role is at the forefront of Microsoft's AI initiatives, working with cutting-edge technologies including generative AI, large language models, and large-scale inference infrastructure.

The Model Scaling Platform team manages the inferencing capacity powering Microsoft's AI ambitions, including OpenAI models that support various Copilots and Azure OpenAI Service. The team oversees a vast fleet of premium AI accelerators, focusing on agile and efficient resource management.

As a Software Engineer II, you'll be instrumental in building next-wave capabilities for the inferencing platform. You'll work alongside talented engineers in a fast-paced environment, helping lay foundations for new systems. The role requires strong technical skills, high motivation, and a methodical approach to problem-solving.

Key responsibilities include distributed systems design and implementation, working with AI/ML technologies, and participating in large-scale projects. The position involves collaboration across team boundaries to tackle complex system problems that directly impact Microsoft's bottom line.

The ideal candidate should have 2+ years of technical engineering experience with languages like C++, Java, Python, etc., and a Bachelor's degree in Computer Science or related field. Experience with distributed systems, Agile development, CI/CD, and familiarity with Azure and large language models is preferred.

This role offers competitive compensation ($100,600 - $199,000 base salary, higher in SF and NYC areas) and comprehensive benefits including healthcare, educational resources, investment options, and parental leave. The position supports Microsoft's mission to empower every person and organization globally, fostering an inclusive work environment where innovation and collaboration thrive.