Principal Software Engineer

We are the AI Frameworks team at Microsoft, part of the CoreAI organization, working at the forefront of large-scale AI innovation. The role focuses on building the end-to-end software stack for Microsoft's first-party AI accelerators, a crucial component of Microsoft's long-term AI infrastructure strategy.

The position involves designing and implementing core components of the AI software stack, optimizing performance for large language models (LLMs), and collaborating across hardware, compiler, and model teams. You'll be working with cutting-edge AI technologies, including PyTorch, ONNX, and various open AI frameworks.

As a Principal Software Engineer, you'll be responsible for developing performance-critical infrastructure, identifying and addressing software bottlenecks, and driving end-to-end performance tuning. The role requires deep expertise in C++ and/or Python, with a strong understanding of software design and optimization.

The position offers competitive compensation, with base pay ranging from $139,900 to $274,800 per year (higher in SF Bay Area and NYC). Microsoft provides comprehensive benefits including healthcare, educational resources, parental leave, and investment options.

This is an opportunity to shape the future of AI at Microsoft, working on systems used at global scale. The role combines deep technical challenges with high-impact outcomes, making it ideal for someone passionate about AI systems and low-level performance optimization.