Taro Logo

Principal Software Engineer

Microsoft is a global technology company that empowers every person and organization on the planet to achieve more.
$220,800 - $331,200
Machine Learning
Principal Software Engineer
Hybrid
5,000+ Employees
6+ years of experience
AI · Enterprise SaaS

Job Description

Microsoft's AI Frameworks team is seeking a Principal Software Engineer to work on cutting-edge AI/ML frameworks that impact hundreds of millions of users. This role focuses on developing software that pushes the boundaries of machine learning performance and experience in both production and research environments.

The team develops critical AI infrastructure powering major Microsoft products including Windows, Office, Microsoft 365, Bing, and others. You'll work on key projects like ONNX (an open standard format for AI models), ONNX Runtime (a high-performance ML inferencing and training accelerator), and Foundry Local (an on-device AI inference solution).

As a Principal Engineer, you'll provide technical leadership, mentor other engineers, and drive architectural decisions that shape the future of AI infrastructure at Microsoft. The role requires deep expertise in AI frameworks, distributed systems, and performance optimization. You'll collaborate across teams to deliver solutions that bridge cutting-edge AI models with hardware ecosystems, enabling AI to run everywhere from cloud supercomputers to mobile devices.

The position offers competitive compensation ($220,800 - $331,200 for Bay Area) and comprehensive benefits including healthcare, educational resources, and parental leave. Microsoft values diversity, inclusion, and work-life balance, encouraging continuous learning and risk-taking in a collaborative environment.

This is an opportunity to make a significant impact on Microsoft's AI infrastructure while working with a talented team that values both technical excellence and personal growth. The role combines deep technical challenges with the opportunity to influence the direction of AI technology at one of the world's leading tech companies.

Last updated a day ago

Responsibilities For Principal Software Engineer

  • Partner with stakeholders to determine user requirements for complex scenarios
  • Provide technical leadership for product, application, service, or platform design
  • Lead by example and mentor others to produce extensible and maintainable code
  • Lead multiple product project plans, release plans, and work items
  • Act as Designated Responsible Individual (DRI)
  • Monitor system/product/service for degradation, downtime, or interruptions
  • Drive consistency in monitoring and operations at scale

Requirements For Principal Software Engineer

Python
  • Bachelor's degree in computer science, or related technical discipline AND 6+ years technical engineering experience
  • Experience with coding in languages including C, C++, C#, Python
  • 6+ years of experience in AI frameworks, large scale distributed computation, system programming, compiler or machine learning
  • 6+ years of experience successfully collaborating with cross functional teams
  • Experience building Android applications from scratch
  • Experience working on systems performance optimization
  • Experience working with Open-Source code

Benefits For Principal Software Engineer

Medical Insurance
Parental Leave
401k
Education Budget
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Related Jobs

Principal Software Engineer

Principal Software Engineer role at Microsoft working on AI Performance team, developing software for running AI models across various platforms.

Principal Software Engineer

Principal Software Engineer role at Microsoft's AI Frameworks team, focusing on large-scale AI and machine learning infrastructure development.

Principal Software Engineer - CoreAI

Principal Software Engineer position at Microsoft's CoreAI team, focusing on developing AI software and infrastructure for various computing platforms.

Principal Software Engineer

Principal Software Engineer role at Microsoft's AI Frameworks team, developing software for advanced AI models and supercomputers. Hybrid role in Mountain View, CA.

Principal AI Engineer

Principal AI Engineer role at Microsoft Security AI, leading next-gen AI-native security products development with focus on LLMs and responsible AI implementation.