ML Compiler Engineer, Annapurna Labs

AWS subsidiary designing silicon and software that accelerates cloud innovation through custom chips and accelerators.
$129,300 - $223,600
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For ML Compiler Engineer, Annapurna Labs

The AWS Neuron Compiler team is seeking skilled compiler engineers to develop a state-of-the-art deep learning compiler stack. This role focuses on optimizing application models across diverse domains, including Large Language and Vision, working with frameworks like PyTorch, TensorFlow, and JAX. As an ML Compiler engineer at Annapurna Labs, you'll work with custom-built Machine Learning accelerators (Inferentia/Trainium) and be instrumental in designing and developing compiler features.

The position involves collaboration with cross-functional teams to ensure system-wide performance optimization. You'll work on crucial aspects including instruction scheduling, memory allocation, data transfer optimization, graph partitioning, parallel programming, and hardware-software co-design. This is an opportunity to work with AWS's innovative custom chips and accelerators that enable cloud solutions previously thought impossible.

The role offers competitive compensation ($129,300-$223,600 based on location) and comprehensive benefits. You'll be part of AWS Utility Computing (UC), which provides foundational services like S3 and EC2, and continues to innovate in cloud computing. The team values knowledge-sharing, mentorship, and career growth, with a strong focus on work-life harmony and inclusive culture.

Key responsibilities include solving challenging technical problems, implementing innovative software solutions, and working in a startup-like environment where impact and customer focus are paramount. The position requires strong technical expertise in compiler design and optimization, with opportunities to work on cutting-edge ML hardware and software systems.

Last updated 19 hours ago

Responsibilities For ML Compiler Engineer, Annapurna Labs

  • Design, develop, and optimize features for ML compiler stack
  • Work on instruction scheduling, memory allocation, and data transfer optimization
  • Collaborate with Runtime, Frameworks, and Hardware teams
  • Contribute to hardware-software co-design
  • Optimize application models across diverse domains including Large Language and Vision
  • Work with custom-built Machine Learning accelerators

Requirements For ML Compiler Engineer, Annapurna Labs

Python
  • B.S. or M.S. in computer science or related field
  • Proficiency with C++ (preferred) or Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of experience developing compiler optimization, graph-theory, hardware bring-up, FPGA placement and routing algorithms, or hardware resource management

Benefits For ML Compiler Engineer, Annapurna Labs

Medical Insurance
401k
  • Medical Insurance
  • 401k

Interested in this job?

Jobs Related To Amazon ML Compiler Engineer, Annapurna Labs

Software Development Engineer - ML, Amazon Demand Side Platform

Senior Software Engineering role at Amazon focusing on machine learning and distributed systems for the Amazon Demand Side Platform, offering competitive compensation and growth opportunities.

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior ML Engineer role at AWS focusing on distributed training solutions for custom ML accelerators, working with LLMs and advanced ML frameworks.

Sr. Machine Learning Engineer, Amazon Music Search

Senior Machine Learning Engineer position at Amazon Music focused on developing AI-powered search solutions and leading technical teams in Bengaluru.

Software Development Engineer, Ring Cloud Computer Vision

Senior Software Engineer role at Amazon Ring, focusing on cloud-based computer vision services and AI-powered distributed systems serving millions of users globally.

Sr Software Dev Engineer, Deep Learning Compilers

Senior Software Engineering role at Amazon focusing on deep learning compiler development for AI acceleration in consumer devices, offering competitive compensation and the chance to work on cutting-edge technology.