Software Engineer- AI/ML, AWS Neuron

Amazon Web Services (AWS) is the world's leading cloud computing platform.
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For Software Engineer- AI/ML, AWS Neuron

AWS Neuron is seeking a talented Software Engineer to join their Machine Learning Applications (ML Apps) team. This role focuses on developing and optimizing the complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators. You'll work on cutting-edge ML technologies, including large language models like LLama3 and Mixtral, while collaborating with chip architects and compiler engineers.

The position offers an exciting opportunity to shape the future of machine learning infrastructure at AWS, working with distributed training systems and performance optimization. You'll be part of a team that values work-life balance, mentorship, and professional growth. The role combines deep technical expertise in both software development and machine learning, making it perfect for engineers passionate about AI infrastructure.

Amazon's inclusive culture, guided by their 16 Leadership Principles, provides a supportive environment with employee-led affinity groups and ongoing learning opportunities. The compensation package is competitive, ranging from $129,300 to $223,600 based on location, plus comprehensive benefits and potential equity compensation.

This role is ideal for someone with strong software development skills and ML knowledge who wants to work on large-scale, impactful projects in the AI/ML infrastructure space. You'll be at the forefront of developing solutions that power some of the most advanced ML applications in cloud computing.

Last updated 7 hours ago

Responsibilities For Software Engineer- AI/ML, AWS Neuron

  • Development, enablement and performance tuning of ML model families
  • Work with large language models like LLama3, Mixtral, DBRX
  • Build distributed training support into PyTorch and JAX
  • Tune models for performance on AWS Trainium and Inferentia silicon
  • Collaborate with chip architects, compiler engineers and runtime engineers

Requirements For Software Engineer- AI/ML, AWS Neuron

Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Experience with Python and ML frameworks
  • Knowledge of distributed training libraries like FSDP and Deepspeed

Benefits For Software Engineer- AI/ML, AWS Neuron

Medical Insurance
Vision Insurance
Dental Insurance
  • Work-life balance
  • Flexible working hours
  • Mentorship & Career Growth
  • Employee-led affinity groups
  • Comprehensive medical benefits

Interested in this job?

Jobs Related To Amazon Software Engineer- AI/ML, AWS Neuron

Systems Engineer, AI/ML

Systems Engineer position at AWS focusing on AI/ML services, combining cloud infrastructure expertise with artificial intelligence systems support.

Software Engineer- AI/ML, AWS Neuron

Software Engineer position for AWS Neuron team working on AI/ML infrastructure and distributed training solutions.

Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior Software Engineer position at AWS Neuron focusing on distributed training solutions for machine learning, working with cutting-edge ML accelerators and frameworks.

Software Development Engineer, Ring AI

Software Development Engineer position at Ring AI (Amazon) in Iasi, Romania, focusing on computer vision and machine learning infrastructure for smart home security solutions.

Systems Development Engineer, AI/ML

Systems Development Engineer position at AWS focusing on AI/ML services, involving cloud infrastructure automation, system operations, and development of large-scale distributed systems.