Sr. Deep Learning Compiler Engineer III, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Sr. Deep Learning Compiler Engineer III, AWS Neuron, Annapurna Labs

Join AWS Neuron team at Amazon as a Senior Deep Learning Compiler Engineer, where you'll work on cutting-edge products at the intersection of machine learning, high-performance computing, and distributed architectures. AWS Neuron is the SDK that optimizes neural net model performance on AWS Inferentia and Trainium custom chips. You'll be part of Annapurna Labs, whose vision is to democratize deep learning for everyday developers.

As a senior engineer, you'll architect and implement business-critical features, publish cutting-edge research, and mentor experienced engineers. The role involves working with AWS ML services teams, participating in pre-silicon design, and bringing new products/features to market. You'll be developing and scaling the compiler to handle the world's largest ML workloads.

The position offers a unique learning culture where teams remain small and agile despite working on large-scale projects. You'll collaborate with diverse teams to impact our global customer base directly. The role combines technical leadership with hands-on development, requiring both deep technical expertise and strong communication skills.

AWS values work-life balance and fosters an inclusive team culture with ten employee-led affinity groups across 190 global chapters. The company embraces diverse experiences and perspectives, following their 16 Leadership Principles that emphasize seeking diverse viewpoints and earning trust.

You'll be working with the Neuron SDK, which includes a compiler, run-time, and debugger, integrated with major frameworks like Tensorflow, PyTorch, and MXNet. This is an opportunity to work on innovative solutions that make deep learning accessible and efficient for AWS customers worldwide.

Last updated 7 minutes ago

Responsibilities For Sr. Deep Learning Compiler Engineer III, AWS Neuron, Annapurna Labs

  • Design, implement, test, deploy and maintain innovative software solutions
  • Build high-quality, highly available, always-on products
  • Research implementations for best possible customer experiences
  • Solve challenging technical problems at every layer of the stack
  • Participate in design discussions and code reviews
  • Work cross-functionally to drive business decisions with technical input
  • Develop and scale compiler targeting AWS Inferentia and Trainum
  • Support development of compiler for handling large ML workloads

Requirements For Sr. Deep Learning Compiler Engineer III, AWS Neuron, Annapurna Labs

Python
  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language
  • 5+ years of leading design or architecture of new and existing systems
  • Experience as a mentor, tech lead or leading an engineering team
  • Bachelor's degree in computer science or equivalent (preferred)

Benefits For Sr. Deep Learning Compiler Engineer III, AWS Neuron, Annapurna Labs

Medical Insurance
Parental Leave
  • Work-life balance
  • Flexible working hours
  • Mentorship opportunities
  • Career growth opportunities
  • Inclusive team culture

Interested in this job?

Jobs Related To Amazon Sr. Deep Learning Compiler Engineer III, AWS Neuron, Annapurna Labs

Machine Learning Engineer, Generative AI Innovation Center

Senior ML Engineering role at AWS's Generative AI Innovation Center, focusing on developing advanced ML models and GenAI solutions for enterprise customers.

Machine Learning Engineer, Generative AI Innovation Center

Senior Machine Learning Engineering role at AWS's Generative AI Innovation Center, focusing on developing and deploying advanced ML solutions for enterprise customers.

Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Senior Machine Learning Compiler Engineer role at AWS Neuron, focusing on optimizing ML model performance through innovative compiler solutions for AWS Inferentia and Trainium platforms.

Sr. Machine Learning - Compiler Engineer III, AWS Neuron, Annapurna Labs

Senior Machine Learning Compiler Engineer role at Amazon's Annapurna Labs, developing ML accelerator technology and compiler systems for AWS Neuron platform.

Member of Technical Staff - Software Engineering - ML Infrastructure, AGI Autonomy

Senior software engineering role at Amazon's new AI research lab, focusing on developing ML infrastructure and tools for AI agent development.