Taro Logo

ML Compiler Engineer II - Neuron Kernel Interface , Annapurna Labs

Amazon is a global technology company and leader in e-commerce, cloud computing, and artificial intelligence.
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Job Description

The AWS Neuron Compiler team is seeking talented compiler engineers to join their innovative efforts in developing cutting-edge deep learning compiler technology. This role focuses on optimizing application models across various domains, including Large Language Models and Vision, working with frameworks like PyTorch, TensorFlow, and JAX.

As an ML Compiler Engineer II, you'll be part of the Neuron Compiler Automated Reasoning Group, where you'll develop and maintain critical tooling to ensure the highest standards of compiler accuracy and reliability. You'll work with custom-built Machine Learning accelerators like Inferentia/Trainium, representing AWS's cutting-edge innovation in ML capabilities.

The position requires strong software development skills in C++/Python and a deep understanding of compiler development. You'll be working at the intersection of compiler technology and machine learning, helping to push the boundaries of what's possible in AI acceleration. The role offers the opportunity to work with state-of-the-art technology and contribute to solutions powering Generative AI applications.

The position offers competitive compensation ranging from $129,300 to $223,600 based on location, plus additional benefits including equity and comprehensive medical coverage. This is an excellent opportunity for someone passionate about compiler technology and machine learning to make a significant impact at one of the world's leading technology companies.

The role requires relocation to either Seattle (preferred), Cupertino, Austin, or Toronto, offering flexibility in location while maintaining the collaborative, in-person work environment essential for this technical role.

Last updated 9 days ago

Responsibilities For ML Compiler Engineer II - Neuron Kernel Interface , Annapurna Labs

  • Develop and maintain tooling for Neuron Compiler's accuracy and reliability
  • Lead efforts building fuzzers and specification synthesis tooling for LLVM-based compiler
  • Work in a team with a science focus
  • Optimize application models across diverse domains including Large Language and Vision

Requirements For ML Compiler Engineer II - Neuron Kernel Interface , Annapurna Labs

Python
  • 3+ years of leading design or architecture experience
  • 2+ years of experience in developing compiler features and optimizations
  • Proficiency in C++ and Python programming
  • Familiarity with LLVM, including knowledge of abstract interpretation and polyhedral domains
  • Demonstrated scientific approach to software engineering problems

Benefits For ML Compiler Engineer II - Neuron Kernel Interface , Annapurna Labs

Medical Insurance
401k
Equity
  • Medical Insurance
  • 401k
  • Equity