Principal Software Engineer - AI Platform

Microsoft develops software and services that empower every person and organization on the planet to achieve more.
$161,600 - $286,200
Machine Learning
Principal Software Engineer
Remote
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Principal Software Engineer - AI Platform

Microsoft's AI Frameworks team is seeking a Principal Software Engineer to join their cutting-edge AI Platform initiative. This role sits at the intersection of AI innovation and systems engineering, developing software that enables AI model deployment across a spectrum of platforms - from supercomputers to mobile devices.

The team develops critical AI infrastructure that powers Microsoft's major products, including the ONNX Runtime which serves trillions of inferences daily across Office, Windows, Bing, SQL Server, and Dynamics. They work directly with OpenAI on models hosted on the Azure OpenAI service, making this an opportunity to shape the future of AI technology at scale.

As a Principal Engineer, you'll be responsible for setting technical direction and architecting solutions that impact Microsoft's AI capabilities globally. The role requires deep expertise in software engineering, with a focus on performance optimization and scalable systems. You'll work with cross-disciplinary teams, combining technical leadership with hands-on development to solve complex challenges in AI infrastructure.

The position offers the opportunity to work with state-of-the-art AI technologies and frameworks, while collaborating with researchers and engineers across Microsoft. You'll be instrumental in designing and implementing systems that enable both training and inference of large-scale AI models, contributing to Microsoft's position as a leader in AI technology.

This role is ideal for someone who combines strong technical abilities with leadership skills, as you'll be mentoring other engineers while driving technical excellence. The work environment is collaborative and inclusive, with opportunities to contribute to open-source projects and shape the direction of AI infrastructure at Microsoft.

Last updated 11 days ago

Responsibilities For Principal Software Engineer - AI Platform

  • Set technical direction for the team
  • Apply engineering principles for defining robust and maintainable architectures and designs
  • Identify requirements, scope solutions, estimate work, schedule deliverables
  • Collaborate with partner teams to drive holistic solutions across the stack
  • Technical leadership and mentoring of software engineers

Requirements For Principal Software Engineer - AI Platform

Python
Java
JavaScript
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience
  • 6+ years of software development experience
  • 5+ years' experience with C/C++
  • 6+ years of technical leadership experience in a software team
  • Technical background and solid foundation in software engineering principles and architecture design
  • Experience in deep learning frameworks (PyTorch, TensorFlow, ONNX)
  • Cross-team collaboration skills
  • Solid communication skills (both written and oral)

Benefits For Principal Software Engineer - AI Platform

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
Education Budget
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Principal Software Engineer - AI Platform

Principal Software Engineer

Principal Software Engineer role at Microsoft Security focusing on AI platform development and security solutions.

Principal Software Engineer

Lead the development of AI software and infrastructure for Microsoft's next-generation supercomputers and AI accelerators, focusing on system software stacks and developer tools.

Principal Software Engineer

Principal Software Engineer position at Microsoft's AI Frameworks team, focusing on developing and optimizing AI software and LLM infrastructure across Microsoft's product ecosystem.

Principal Software Engineer

Principal Software Engineer role at Microsoft focusing on AI/ML for advertising technology, offering competitive pay and benefits with hybrid work options in Redmond or Mountain View.

Principal Software Engineer

Principal Software Engineer position at Microsoft's AI Frameworks team, developing AI software and working with OpenAI to build and scale AI models across various platforms.