Taro Logo

Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Amazon is a global technology company leading in e-commerce, cloud computing, AI, and digital innovation.
$151,300 - $261,500
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Job Description

AWS Neuron team is seeking a Senior Machine Learning Compiler Engineer to join their innovative team working on ML accelerators at the forefront of AWS innovation. The role focuses on developing a cutting-edge compiler stack for deep learning frameworks like TensorFlow, PyTorch, and MXNET. The position involves working with AWS Machine Learning accelerators, including the Inferentia chip, which delivers best-in-class ML inference performance at the lowest cost in cloud, and Trainium, designed for ML training performance.

The successful candidate will be part of Amazon Annapurna Labs team, responsible for silicon development at AWS. They will work on optimizing complex neural net models on custom-built AWS hardware, collaborating with some of the brightest minds in engineering, research, and product communities. The role offers opportunities to architect and implement critical features, publish research, and mentor experienced engineers.

The position offers excellent work-life balance, with flexibility in working hours and a strong emphasis on personal and professional development. The team culture promotes inclusion, knowledge sharing, and mentorship, with opportunities for career growth through challenging projects and continuous learning. The role requires expertise in compiler development, machine learning, and team leadership, with opportunities to work on groundbreaking technology used by major customers like Snap, Autodesk, Amazon Alexa, and Amazon Rekognition.

This is an exceptional opportunity for a senior engineer passionate about machine learning, compiler optimization, and hardware acceleration to make a significant impact in the field of AI infrastructure. The role combines technical leadership with hands-on development, requiring both deep technical expertise and strong communication skills to collaborate with various AWS teams and contribute to the next generation of ML computing solutions.

Last updated 19 days ago

Responsibilities For Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

  • Support ground-up development and scaling of a compiler for ML workloads
  • Architect and implement business-critical features
  • Publish cutting-edge research
  • Mentor experienced engineers
  • Partner with AWS ML services teams
  • Participate in pre-silicon design
  • Bring new products/features to market

Requirements For Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Python
  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language experience
  • 5+ years of leading design or architecture experience
  • 5+ years of full software development life cycle experience
  • Experience as a mentor, tech lead or leading an engineering team

Benefits For Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Medical Insurance
401k
  • Work-life balance
  • Mentorship & Career Growth
  • Flexible working hours