Taro Logo

Software Development Engineer, Annapurna Labs, Trainium Collectives

Annapurna Labs, an integral part of AWS, develops hardware and software components for EC2 infrastructure.
$129,300 - $223,600
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Software Development Engineer, Annapurna Labs, Trainium Collectives

Join Annapurna Labs, a crucial division of AWS, as a Senior Software Engineer focused on distributed AI/ML systems. This role puts you at the forefront of AI/ML development, working on collective operations that enable AI to scale across multiple accelerators and servers. You'll be part of a team that develops critical hardware and software components for EC2 infrastructure, where every instance runs on hardware designed by Annapurna Labs.

The position requires expertise in C/C++ programming, Linux systems, and kernel-level development. You'll work alongside infrastructure experts, hardware engineers, RTL engineers, and scientists in a truly international environment. The team values mentorship, with opportunities to both receive guidance from senior engineers and mentor junior team members.

Working at AWS means being part of the world's most comprehensive cloud platform. The role offers competitive compensation ranging from $129,300 to $223,600 based on location and experience, plus equity and comprehensive benefits. The team emphasizes work-life harmony and provides flexibility in working hours.

You'll be working on features for the largest AI clusters, collaborating with major customers on the largest AI models. The fast-paced environment encourages continuous learning, as the AI/ML field constantly evolves. Career growth opportunities are abundant, with access to principal-level engineers and directors.

The ideal candidate brings 3+ years of software development experience, strong system design skills, and a passion for high-performance computing. Experience with high-speed networking or HPC interconnects is highly valued. Join us in shaping the future of cloud computing and AI infrastructure while working with cutting-edge technology in a supportive, diverse environment.

Last updated 4 months ago

Responsibilities For Software Development Engineer, Annapurna Labs, Trainium Collectives

  • Work on distributed AI/ML systems and collective operations
  • Develop features for large-scale AI clusters
  • Optimize AWS customer experience through hardware and software components
  • Collaborate with infrastructure experts, hardware engineers, and RTL engineers
  • Mentor new and junior engineers

Requirements For Software Development Engineer, Annapurna Labs, Trainium Collectives

Linux
  • 3+ years of non-internship professional software development experience
  • 2+ years of system design and architecture experience
  • Experience with Linux, kernels, and performant code
  • Programming experience in at least one programming language
  • Experience with high-speed networking or HPC interconnects (preferred)

Benefits For Software Development Engineer, Annapurna Labs, Trainium Collectives

Medical Insurance
Mental Health Assistance
  • Medical benefits
  • Work-life balance
  • Career growth opportunities
  • Mentorship program
  • Flexible working hours