Principal Software Engineer

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further.
$137,600 - $267,000
Distributed Systems
Principal Software Engineer
Remote
5,000+ Employees
10+ years of experience
AI · Enterprise SaaS · Cloud

Description For Principal Software Engineer

Microsoft's AI Platform organization builds the end-to-end Azure AI stack/PaaS and is core to Azure's innovation and differentiation, as well as all of Microsoft's flagship products. The team is responsible for Azure OpenAI, Azure ML, Cognitive Services, and the global Azure AI infrastructure for running the largest AI workloads on the planet.

As a Principal Software Engineer in the Azure ML team, you will be working on enabling data scientists and developers to quickly and easily build, train, deploy, manage, and consume machine learning models. This role offers an opportunity to shape the future of AI infrastructure at Microsoft, working with cutting-edge technologies and large-scale systems.

The position involves architecting and developing core AI Infrastructure services that support large-scale AI training and inferencing. You'll be working with modern technologies like Kubernetes, Go, Rust, and Python, while ensuring high stability, efficiency, and security of the systems. The role requires both technical excellence and leadership skills, as you'll be providing vision and expertise to team members while collaborating with engineers, data scientists, and Microsoft Research teams.

Microsoft offers an inclusive work environment where passionate innovators come to collaborate and achieve more. The company values differences and actively seeks out diverse perspectives to better serve their customers. With industry-leading benefits, opportunities for professional growth, and a culture of innovation, this role presents an exciting opportunity to be at the forefront of AI technology while working with some of the largest AI workloads on the planet.

The position offers competitive compensation with a base pay range of $137,600 - $267,000 per year (higher in SF Bay Area and NYC), along with comprehensive benefits including healthcare, educational resources, savings and investments, parental leave, and generous time away. While remote work is possible, you'll be part of a geo-distributed team working on critical AI infrastructure that powers Microsoft's flagship products.

Last updated 10 hours ago

Responsibilities For Principal Software Engineer

  • Work on the architecture, design, and development of the core AI Infrastructure services that support large scale AI training and inferencing
  • Design, Develop, test, and maintain Kubernetes clusters, and based data-plane services written in Go, Rust, Python
  • Enhance systems and applications to ensure high stability, efficiency, & maintainability, low latency, tight cloud security
  • Provide operational support and DRI responsibilities for the product
  • Develop and foster a deep understanding of the machine learning systems and concepts and their usage by our customers
  • Collaborate closely with engineers, data scientists within the team, internal Microsoft Research teams and external enterprises
  • Provide vision, expertise, and technical leadership to other team members
  • Help to grow talent in these areas

Requirements For Principal Software Engineer

Go
Python
Rust
Kubernetes
Linux
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
  • 3+ years of experience and knowledge of Linux, Kubernetes, Containers, Container Networking, CNI plug-ins
  • Experience in distributed systems and services
  • Must pass Microsoft Cloud background check upon hire/transfer and every two years thereafter

Benefits For Principal Software Engineer

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Principal Software Engineer

Principal Software Engineer

Principal Software Engineer role at Microsoft working on Azure Cosmos DB, building distributed database systems and shaping the future of cloud database solutions.

Principal Software Engineer

Lead the development of Microsoft 365 Copilot's search infrastructure as a Principal Software Engineer, designing and building AI-powered productivity tools at scale.

Principal Software Engineer

Principal Software Engineer role at Microsoft leading platform efforts for Content Ecosystem & Growth team, building distributed systems serving 100M+ users with AI/LLM technology.

Principal Software Engineer

Principal Software Engineer role at Microsoft Security leading development of exabyte-scale security data platform, focusing on distributed systems and security challenges.

Principal Software Engineer

Principal Software Engineer role at Microsoft Azure Core, building and managing cloud infrastructure services at massive scale with competitive compensation and flexible work arrangements.