Software Engineer II

Microsoft's AI Frameworks team, part of the CoreAI organization, is seeking a Software Engineer II to join their specialized sub-team focused on building the end-to-end software stack for Microsoft's first-party AI accelerators. This role is crucial to Microsoft's long-term AI infrastructure strategy, working at the intersection of deep learning, hardware optimization, and distributed systems.

The position involves developing and optimizing components for Microsoft's AI accelerator software stack, working with cutting-edge large language model (LLM) technologies. You'll collaborate with hardware architects, compiler teams, and model experts to co-design software solutions that maximize the potential of custom silicon. The role requires strong programming skills in languages like C++, Python, and experience with AI frameworks.

As a Software Engineer II, you'll contribute to Microsoft's mission of enabling state-of-the-art large language model training and inference through deep optimization across the full software and hardware stack. The team works with technologies like PyTorch, ONNX, and other open AI frameworks, focusing on performance, scalability, and efficiency across various hardware accelerators.

The position offers competitive compensation with a base salary range of $100,600 - $199,000 (higher in SF Bay Area and NYC), comprehensive benefits including healthcare, educational resources, and investment options. You'll work in a hybrid environment from the Redmond office, with up to 50% work from home flexibility and minimal travel requirements (0-25%).

This is an exceptional opportunity for engineers passionate about AI systems and low-level performance optimization to work on technology that will power next-generation AI models and services across Azure and Microsoft products. The role combines deep technical challenges with global impact, making it ideal for those looking to shape the future of AI infrastructure.