Taro Logo

Principal Software Engineer

Microsoft is a global technology company that develops software, cloud services, and AI solutions.
$139,900 - $274,800
Machine Learning
Principal Software Engineer
Hybrid
5,000+ Employees
12+ years of experience
AI

Job Description

Microsoft's Artificial Intelligence (AI) Frameworks team is at the forefront of developing AI software for training and deploying the world's most advanced AI models. This Principal Software Engineer role offers an exciting opportunity to work on cutting-edge AI technologies, collaborating with hardware teams and partners to build software stacks for Microsoft's next-generation supercomputers and the Maia AI accelerator.

The team operates at the intersection of AI algorithmic innovation, purpose-built AI hardware, systems, and software. You'll be working with a cross-discipline team of highly capable professionals in a collaborative and inclusive culture, focused on supporting and driving the AI future. The role involves hands-on software design and development, particularly in training and serving Deep Neural Network models and Language Models.

As a Principal Engineer, you'll be responsible for building software tools to support validation and exploration of LLM optimization technologies, performing development in languages like Python, C/C++, and CUDA. You'll collaborate with ML researchers, system engineers, and production engineers to evaluate and optimize performance of state-of-the-art LLMs at different scales.

The position offers competitive compensation ($139,900 - $274,800) and comprehensive benefits including healthcare, educational resources, and parental leave. This is a hybrid role based in Mountain View, CA, with up to 50% work from home flexibility and 0-25% travel requirements. The role requires strong technical expertise combined with excellent communication skills and the ability to drive technical initiatives independently.

Last updated a day ago

Responsibilities For Principal Software Engineer

  • Collaborate broadly with ML researchers, system engineers, and production engineers
  • Engage with key partners to understand and evaluate performance and quality for state-of-the-art LLMs at different scales
  • Build software tools to support validation and exploration of LLM optimization technologies
  • Perform software development in model scripting and/or kernel languages, such as Python, C/C++, CUDA
  • Identify requirements, scope solutions, estimate work, schedule deliverables

Requirements For Principal Software Engineer

Python
Linux
  • Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
  • 4+ years' practical experience related to machine learning, including modeling, application, or system/kernel optimization
  • Strong communication skills (both written and oral)
  • Experience in training or serving Deep Neural Network models
  • Experience with Language Models and ML system optimization (preferred)

Benefits For Principal Software Engineer

Medical Insurance
Dental Insurance
Vision Insurance
Parental Leave
401k
  • Industry leading healthcare
  • Educational resources
  • Discounts on products and services
  • Savings and investments
  • Maternity and paternity leave
  • Generous time away
  • Giving programs
  • Opportunities to network and connect

Related Jobs

Principal Software Engineer

Principal Software Engineer role at Microsoft working on AI Performance team, developing software for running AI models across various platforms.

Principal Software Engineer

Principal Software Engineer role at Microsoft's AI Frameworks team, developing cutting-edge AI/ML infrastructure powering major Microsoft products. Bay Area position offering $220,800-$331,200.

Principal Software Engineer

Principal Software Engineer role at Microsoft's AI Frameworks team, focusing on large-scale AI and machine learning infrastructure development.

Principal Software Engineer - CoreAI

Principal Software Engineer position at Microsoft's CoreAI team, focusing on developing AI software and infrastructure for various computing platforms.

Principal AI Engineer

Principal AI Engineer role at Microsoft Security AI, leading next-gen AI-native security products development with focus on LLMs and responsible AI implementation.