Taro Logo

Software Development Engineer, Annapurna Labs, Trainium Collectives

Annapurna Labs, an integral part of AWS, develops hardware and software components for EC2 infrastructure.
$129,300 - $223,600
Senior Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For Software Development Engineer, Annapurna Labs, Trainium Collectives

Annapurna Labs, a crucial component of AWS, is seeking an experienced engineer to join their team working on cutting-edge distributed AI/ML systems. This role focuses on developing collective operations - the fundamental building blocks that enable AI to scale across multiple accelerators and servers. The position involves working with a low-level C/C++ stack, requiring strong knowledge of Linux, kernels, and high-performance computing.

The team operates within Annapurna Labs, which is integral to AWS and develops critical hardware and software components for EC2 infrastructure. Every EC2 instance runs on hardware designed by Annapurna Labs. The work environment is truly international, with team members from diverse backgrounds collaborating globally.

As a Software Development Engineer, you'll work alongside infrastructure experts, hardware engineers, RTL engineers, scientists, and architects. The role offers significant opportunities for both receiving and providing mentorship, with senior guidance available and expectations to mentor junior engineers. The fast-paced environment focuses on the latest AI/ML advancements while maintaining a strong commitment to work-life balance and flexible working hours.

The position offers competitive compensation ranging from $129,300 to $223,600 per year, depending on location and experience. Career growth opportunities are abundant, with access to principal-level engineers and directors. The role is perfect for those passionate about continuous learning, as the AI/ML field constantly evolves.

Key responsibilities include developing distributed systems, optimizing performance, collaborating across disciplines, and working on features for the largest AI clusters. The ideal candidate will have 3+ years of software development experience, strong systems programming knowledge, and a passion for solving complex technical challenges.

The team culture emphasizes knowledge-sharing, mentorship, and inclusive practices. AWS values diverse experiences and backgrounds, encouraging applications from candidates with non-traditional career paths. The company offers comprehensive benefits, including medical insurance, and promotes a healthy work-life harmony.

This role represents an opportunity to work at the forefront of AI/ML technology, developing solutions that will shape the future of cloud computing and machine learning infrastructure.

Last updated 15 days ago

Responsibilities For Software Development Engineer, Annapurna Labs, Trainium Collectives

  • Work on distributed AI/ML systems
  • Develop collective operations for AI scaling across multiple accelerators & servers
  • Write performant low-level C/C++ code
  • Collaborate with infrastructure experts, hardware engineers, RTL engineers, scientists & architects
  • Mentor new and junior engineers
  • Work on features for large clusters and AI models

Requirements For Software Development Engineer, Annapurna Labs, Trainium Collectives

Linux
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Knowledge of Linux, kernels, and performant code
  • Experience with embedded systems (preferred)
  • Experience with high-speed networking or HPC interconnects (highly valued)

Benefits For Software Development Engineer, Annapurna Labs, Trainium Collectives

Medical Insurance
  • Medical Insurance
  • Work-life balance
  • Career growth opportunities
  • Mentorship program
  • Flexible working hours

Interested in this job?

Jobs Related To Amazon Software Development Engineer, Annapurna Labs, Trainium Collectives