Principal Software Engineer

Microsoft is a global technology company that develops software, hardware, and AI solutions.
Machine Learning
Principal Software Engineer
Hybrid
5,000+ Employees
12+ years of experience
AI · Enterprise SaaS

Description For Principal Software Engineer

Microsoft's Artificial Intelligence (AI) Frameworks team is at the forefront of developing AI software for training and deploying the world's most advanced AI models. This role offers an exciting opportunity to work on cutting-edge AI technology, collaborating with hardware teams and partners to build software stacks for Microsoft's next-generation supercomputers and the new Maia-100 AI accelerator.

As a Principal Software Engineer, you'll be working at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software. The team focuses on building system software stacks and developer tools (debugger, profiler, simulator) for novel AI accelerators, while collaborating closely with ML researchers and developers to optimize and scale out model training and inference.

This position requires exceptional software engineering skills, with a focus on low-level system development and AI infrastructure. You'll be responsible for designing and implementing critical components of Microsoft's AI platform, working with cross-functional teams to deliver high-performance solutions. The role demands both technical excellence and leadership, as you'll be guiding technical decisions and mentoring team members.

The ideal candidate brings deep expertise in systems programming, particularly with C/C++, and has experience with AI/ML frameworks. You'll need to demonstrate strong architectural thinking and the ability to lead complex technical initiatives. This is an opportunity to shape the future of AI infrastructure at Microsoft, working with state-of-the-art technology and contributing to groundbreaking advancements in AI computing.

Benefits include comprehensive healthcare, educational resources, investment options, parental leave, and a collaborative culture that values innovation and technical excellence. Join Microsoft's AI Frameworks team to work on challenging problems in building end-to-end AI stacks and help drive the next generation of AI computing infrastructure.

Last updated 17 hours ago

Responsibilities For Principal Software Engineer

  • Identify requirements, scope solutions, estimate work, schedule deliverables
  • Apply strong engineering principles for defining robust and maintainable architectures and designs
  • Collaborate broadly across multiple disciplines from hardware designers, tool developers, performance analysis and with ML application developers
  • Perform software development in C/C++, C#, Python, and other languages
  • Owns the next gen features of Microsoft AI accelerator directly contributing to the business impact

Requirements For Principal Software Engineer

Python
Linux
  • B.S. or advanced degree in computer engineering, computer science, or related fields
  • 12+ years of software development and experience of leading at least two commercialized features from requirement to deployment
  • 5+ years' experience with C/C++
  • Strong technical background and solid foundation in software engineering principles and architecture design
  • Experience in developing SW/FW for multicore chips
  • Exposure to firmware, low level software development or embedded systems
  • Strong communication skills (both written and oral)
  • Exposure to AI development environment (such as CUDA/RcoM/pytorch/Tensorflow)

Benefits For Principal Software Engineer

Medical Insurance
Parental Leave
401k
Vision Insurance
Dental Insurance
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Interested in this job?

Jobs Related To Microsoft Principal Software Engineer

Principal Software Engineer

Principal Software Engineer role at Microsoft Security focusing on AI platform development and security solutions.

Principal Software Engineer

Principal Software Engineer role at Microsoft working on Azure Machine Learning, optimizing LLMs and Diffusion models for high-scale inference, collaborating directly with OpenAI.

Principal Software Engineer

Principal Software Engineer role at Microsoft's Core AI division, focusing on building AI platforms and developer experiences for LLM technologies.

Principal Software Engineer

Principal Software Engineer position at Microsoft's AI Frameworks team, focusing on developing and optimizing AI software and LLM infrastructure across Microsoft's product ecosystem.

Principal Software Engineer - AI Platform

Lead the development of Microsoft's AI platform infrastructure, architecting solutions for AI model deployment from supercomputers to mobile devices, working directly with OpenAI and internal teams.