ML Compiler Engineer I, Annapurna Labs

Annapurna Labs builds custom Machine Learning accelerators for AWS, focusing on ML inference and training technologies.
$99,500 - $200,000
Machine Learning
Entry-Level Software Engineer
In-Person
5,000+ Employees
AI · Enterprise SaaS

Description For ML Compiler Engineer I, Annapurna Labs

Annapurna Labs, now fully integrated into AWS after its 2015 acquisition, is seeking a Machine Learning Compiler Engineer I to join their innovative team. This role focuses on developing and scaling compilers for large-scale ML workloads on custom AWS Machine Learning accelerators.

The position is part of the Neuron Compiler team, which is responsible for creating a deep learning compiler stack that optimizes models from frameworks like TensorFlow, PyTorch, and JAX for AWS accelerators. The team's work directly impacts AWS's ML infrastructure, supporting major customers like Snap, Autodesk, and Amazon Alexa.

As an ML Compiler Engineer I, you'll be working on groundbreaking compiler development projects, implementing critical features, and contributing to cutting-edge research. The role requires strong technical communication skills as you'll partner with AWS ML services teams and be involved in pre-silicon design and product development.

The position offers competitive compensation ranging from $99,500 to $200,000 based on location, plus additional benefits including equity, sign-on payments, and comprehensive medical coverage. This is an excellent opportunity for recent graduates with compiler development experience to join one of tech's most innovative teams.

The role requires relocation to either Cupertino (preferred), Seattle, or Toronto, offering the chance to work in major tech hubs. You'll be part of a team developing next-generation ML acceleration technologies, working alongside experienced engineers and researchers in a collaborative environment.

This position is ideal for someone passionate about compiler technology and machine learning, offering the opportunity to work on large-scale projects that directly impact AWS's ML infrastructure. The role combines technical challenges with business impact, making it an excellent starting point for a career in advanced computing systems.

Last updated 15 minutes ago

Responsibilities For ML Compiler Engineer I, Annapurna Labs

  • Support ground-up development and scaling of ML compiler
  • Architect and implement business-critical features
  • Publish cutting-edge research
  • Partner with AWS ML services teams
  • Contribute to pre-silicon design
  • Write requirements documents, design documents, and test plans
  • Communicate status and progress to stakeholders

Requirements For ML Compiler Engineer I, Annapurna Labs

Python
  • Bachelors or Masters degree earned between December 2022 and September 2025
  • Proficiency in C++ and Python programming, applied to compiler projects
  • Experience developing compiler optimizations or ML framework internals

Benefits For ML Compiler Engineer I, Annapurna Labs

Medical Insurance
401k
  • Medical benefits
  • Financial benefits
  • Sign-on payments
  • Equity compensation

Interested in this job?

Jobs Related To Annapurna Labs (U.S.) Inc. ML Compiler Engineer I, Annapurna Labs

Founding ML Engineer

Founding ML Engineer position at Proxis, building enterprise AI agent automations for email and business processes.

AI Engineer - Customer Service

AI Engineer position at Harper focused on building sophisticated voice AI and customer service automation systems for an AI-native insurance brokerage.

Software Engineer II, Cloud AI, Early Career

Early-career Software Engineer II position at Google Cloud AI team, focusing on search features, Kubernetes infrastructure, and GenAI capabilities.

Software Engineer, AICore, Platforms and Devices

Software Engineering role at Google focusing on implementing and optimizing AI models for mobile applications, working with Gemini model and Android ecosystem.

ASIC Engineer, Machine Learning Architecture

ASIC Engineer role at Meta focusing on machine learning architecture design and implementation for data center acceleration, offering competitive compensation and benefits.