Taro Logo

Sr. Software Development Engineer, Annapurna Labs

Amazon Annapurna Labs is an AWS organization building innovation in silicon and software for AWS customers, focusing on cloud infrastructure and ML chips.
$151,300 - $261,500
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
10+ years of experience
AI · Enterprise SaaS

Job Description

Amazon Annapurna Labs is seeking a Senior Software Development Engineer to lead a critical technical team focused on profiling and optimization tools for Neuron ML accelerators fleet. This role sits at the intersection of hardware and software, working to ensure optimal performance profiling capabilities for large ML workloads.

The position involves leading the Neuron Core Tools team, which develops and maintains essential profiling software and enables performance engineers to develop and improve custom kernels affecting large workload efficiency. You'll work closely with frameworks and compiler teams, collecting requirements from various stakeholders including training, inference, and runtime teams.

As part of AWS Utility Computing (UC), you'll contribute to Amazon's cloud infrastructure innovation, particularly in high-performance machine learning with AWS Neuron, Inferentia, and Trainium ML chips. The role offers exposure to Amazon's growing suite of generative AI services and cloud computing offerings.

The team culture emphasizes knowledge-sharing and mentorship, with senior members providing one-on-one mentoring and thorough code reviews. AWS values diverse experiences and maintains an inclusive environment through employee-led affinity groups and ongoing learning experiences like Conversations on Race and Ethnicity (CORE) and AmazeCon conferences.

Work-life harmony is prioritized, with flexibility as a key aspect of the working culture. Career growth is supported through extensive knowledge-sharing, mentorship, and professional development resources. The position offers competitive compensation ranging from $151,300 to $261,500 per year based on geographic location, plus equity, sign-on payments, and comprehensive benefits.

This role represents an opportunity to work with cutting-edge ML hardware/software integration, contribute to large-scale applications, and impact AWS's machine learning infrastructure. The ideal candidate will bring 10+ years of engineering experience, strong technical leadership capabilities, and a track record of delivering consumer software experiences.

Last updated 4 hours ago

Responsibilities For Sr. Software Development Engineer, Annapurna Labs

  • Lead technical team for Neuron ML accelerators fleet profiling and optimization tools
  • Work with hardware and software teams on performance profiling tools
  • Collect requirements from training, inference and runtime teams
  • Collaborate with compiler performance team
  • Provide technical leadership to the Neuron Core Tools team
  • Develop tools to increase efficiency in large scale compute

Requirements For Sr. Software Development Engineer, Annapurna Labs

Python
Java
JavaScript
  • 10+ years of engineering experience
  • 10+ years of planning, designing, developing and delivering consumer software experience
  • Experience partnering with product or program management teams
  • Experience as a tech lead of a large group of engineers

Benefits For Sr. Software Development Engineer, Annapurna Labs

Medical Insurance
401k
Parental Leave
  • Work-life harmony focus
  • Flexible working culture
  • Mentorship opportunities
  • Career development resources
  • Employee-led affinity groups
  • Inclusive team culture