Taro Logo

Sr ML Compiler Engineer, Annapurna Labs

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$151,300 - $261,500
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Sr ML Compiler Engineer, Annapurna Labs

AWS Machine Learning accelerators are at the forefront of AWS innovation, focusing on building Generative AI solutions. The role is within the Amazon Annapurna Labs team, responsible for silicon development at AWS. As a Sr. Machine Learning Compiler Engineer III on the AWS Neuron team, you'll be developing a cutting-edge compiler stack for neural networks, working with frameworks like TensorFlow, PyTorch, and MXNET. The position involves optimizing performance of complex neural net models on custom-built AWS hardware.

The team is developing the AWS Neuron Software Development Kit (SDK), which includes an ML compiler, runtime, and integrates with popular ML frameworks. Their products, Inferentia and Trainium chips, deliver best-in-class ML inference and training performance at the lowest cost in cloud. These solutions are used by major customers like Snap, Autodesk, Amazon Alexa, and Amazon Rekognition.

You'll be working alongside some of the brightest minds in engineering, research, and product development, focused on creating a revolutionary toolchain for quantum leap performance improvements. The role requires strong technical communication skills and involves partnerships with AWS ML services teams. You'll contribute to pre-silicon design, product launches, and various innovative projects.

The position offers comprehensive benefits, competitive compensation based on location ($151,300-$261,500/year base pay), plus equity and other benefits. Amazon values work-life harmony and provides extensive career development opportunities, including mentorship and knowledge-sharing resources. The company embraces diversity through employee-led affinity groups and fosters an inclusive culture that celebrates differences.

Last updated 8 minutes ago

Responsibilities For Sr ML Compiler Engineer, Annapurna Labs

  • Support ground-up development and scaling of a compiler for ML workloads
  • Architect and implement business-critical features
  • Publish cutting-edge research
  • Mentor experienced engineers
  • Partner with AWS ML services teams
  • Participate in pre-silicon design
  • Bring new products/features to market

Requirements For Sr ML Compiler Engineer, Annapurna Labs

Python
  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language experience
  • 5+ years of leading design or architecture of new and existing systems experience
  • 5+ years of full software development life cycle experience
  • Experience as a mentor, tech lead or leading an engineering team

Benefits For Sr ML Compiler Engineer, Annapurna Labs

Medical Insurance
401k
  • Full range of medical benefits
  • Financial benefits
  • Equity compensation
  • Sign-on payments
  • Work-life harmony
  • Career development resources
  • Mentorship opportunities

Interested in this job?

Jobs Related To Amazon Sr ML Compiler Engineer, Annapurna Labs

Sr SOC Verification Engineer, Annapurna ML

Senior SOC Verification Engineer role at AWS, focusing on custom chip design verification for cloud-scale machine learning acceleration.

Sr. Amazon Q Delivery Engineer, Amazon Q Customer Success Team (Q-CST)

Senior Amazon Q Delivery Engineer position focusing on implementing enterprise-scale Generative AI solutions using Amazon Q and AWS AI/ML services, requiring 7+ years of cloud architecture experience.

Sr. Deep Learning Compiler Engineer III, AWS Neuron, Annapurna Labs

Senior Deep Learning Compiler Engineer role at AWS Neuron team, focusing on ML infrastructure optimization, compiler development, and technical leadership in a collaborative environment.

Senior SoC Architectural Modeling Engineer, AWS Machine Learning Accelerators

Senior SoC Modeling Engineer position at AWS, developing functional models for machine learning accelerator chips, requiring expertise in C++/SystemC and hardware modeling.

Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Senior Machine Learning Compiler Engineer position at AWS Neuron team, focusing on optimizing ML models for AWS Inferentia and Trainium custom chips.