ML Compiler Engineer, AWS Neuron, Annapurna Labs

Amazon Web Services (AWS) is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For ML Compiler Engineer, AWS Neuron, Annapurna Labs

AWS Neuron is seeking a talented ML Compiler Engineer to join their team working on cutting-edge products at the intersection of machine learning, high-performance computing, and distributed architectures. As part of Annapurna Labs, acquired by AWS in 2015, you'll work on the AWS Neuron SDK that optimizes neural net model performance on AWS Inferentia and Trainium custom chips.

The role involves developing and scaling a compiler to handle the world's largest ML workloads, working with AWS ML services teams, and contributing to pre-silicon design and new product features. You'll be part of the team that builds the compiler, runtime, and debugger integrated with major frameworks like TensorFlow, PyTorch, and MXNet.

This position offers the unique opportunity to work in a startup-like environment within AWS, focusing on infrastructure that powers AWS services. You'll collaborate with diverse teams across silicon engineering, hardware design, software, and operations. The team has delivered impressive products including AWS Nitro, ENA, EFA, Graviton, and ML accelerators.

The ideal candidate will bring strong technical capabilities and curiosity, with the ability to solve complex problems across the full software stack. While machine learning and AI accelerator experience is preferred, it's not required. You'll work in small, agile teams with significant autonomy to innovate and experiment.

The role offers excellent career growth opportunities through mentorship, knowledge sharing, and exposure to cutting-edge technology. AWS values work-life balance and fosters an inclusive culture with employee-led affinity groups and ongoing learning experiences. You'll be part of a team that embraces diverse perspectives and experiences while working on products that impact millions of customers worldwide.

Last updated 8 hours ago

Responsibilities For ML Compiler Engineer, AWS Neuron, Annapurna Labs

  • Design, implement, test, deploy and maintain innovative software solutions
  • Build high-quality, highly available, always-on products
  • Research implementations for best possible customer experiences
  • Create metrics and implement automation improvements
  • Resolve root cause of software defects
  • Work cross-functionally to drive business decisions with technical input
  • Participate in design discussions and code reviews

Requirements For ML Compiler Engineer, AWS Neuron, Annapurna Labs

Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language

Benefits For ML Compiler Engineer, AWS Neuron, Annapurna Labs

  • Work-life balance
  • Flexible working hours
  • Mentorship and career growth opportunities
  • Inclusive team culture

Interested in this job?

Jobs Related To Amazon ML Compiler Engineer, AWS Neuron, Annapurna Labs

Software Development Engineer, Ring AI

Software Development Engineer position at Ring AI, focusing on computer vision and machine learning infrastructure to enhance smart home security solutions.

ML Compiler Engineer II - Automated Reasoning Science, Annapurna Labs

ML Compiler Engineer II position at Amazon's AWS Neuron Compiler team, focusing on developing advanced compiler technology for machine learning applications with competitive compensation and benefits.

Machine Learning - Compiler Engineer II, Annapurna Labs

ML Compiler Engineer role at AWS developing cutting-edge compiler technology for machine learning accelerators, focusing on performance optimization and framework integration.

Software Dev Engineer II - AI ML

AWS QuickSight is seeking a Software Dev Engineer II to build world-class experiences and services for their cloud-based Business Intelligence platform.

Cloud Support Engineer - SVO (Machine Learning), Support Engineering

AWS Cloud Support Engineer role specializing in Machine Learning, combining technical expertise with customer support to help clients optimize ML workloads on AWS platform.