Taro Logo

Principal Software Engineer - AI Platform

Microsoft develops software and services that empower every person and organization on the planet to achieve more.
$161,600 - $286,200
Machine Learning
Principal Software Engineer
Remote
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Principal Software Engineer - AI Platform

Microsoft's AI Frameworks team is seeking a Principal Software Engineer to join their cutting-edge AI Platform initiative. This role sits at the intersection of AI innovation and systems engineering, developing software that enables AI model deployment across a spectrum of platforms - from supercomputers to mobile devices.

The team develops critical AI infrastructure that powers Microsoft's major products, including the ONNX Runtime which serves trillions of inferences daily across Office, Windows, Bing, SQL Server, and Dynamics. They work directly with OpenAI on models hosted on the Azure OpenAI service, making this an opportunity to shape the future of AI technology at scale.

As a Principal Engineer, you'll be responsible for setting technical direction and architecting solutions that impact Microsoft's AI capabilities globally. The role requires deep expertise in software engineering, with a focus on performance optimization and scalable systems. You'll work with cross-disciplinary teams, combining technical leadership with hands-on development to solve complex challenges in AI infrastructure.

The position offers the opportunity to work with state-of-the-art AI technologies and frameworks, while collaborating with researchers and engineers across Microsoft. You'll be instrumental in designing and implementing systems that enable both training and inference of large-scale AI models, contributing to Microsoft's position as a leader in AI technology.

This role is ideal for someone who combines strong technical abilities with leadership skills, as you'll be mentoring other engineers while driving technical excellence. The work environment is collaborative and inclusive, with opportunities to contribute to open-source projects and shape the direction of AI infrastructure at Microsoft.

Last updated 3 months ago

Responsibilities For Principal Software Engineer - AI Platform

  • Set technical direction for the team
  • Apply engineering principles for defining robust and maintainable architectures and designs
  • Identify requirements, scope solutions, estimate work, schedule deliverables
  • Collaborate with partner teams to drive holistic solutions across the stack
  • Technical leadership and mentoring of software engineers

Requirements For Principal Software Engineer - AI Platform

Python
Java
JavaScript
  • Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience
  • 6+ years of software development experience
  • 5+ years' experience with C/C++
  • 6+ years of technical leadership experience in a software team
  • Technical background and solid foundation in software engineering principles and architecture design
  • Experience in deep learning frameworks (PyTorch, TensorFlow, ONNX)
  • Cross-team collaboration skills
  • Solid communication skills (both written and oral)

Benefits For Principal Software Engineer - AI Platform

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
Education Budget
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?