Taro Logo

Software Engineer- AI/ML, AWS Neuron

Amazon Web Services (AWS) division developing cloud-scale machine learning accelerators and software
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For Software Engineer- AI/ML, AWS Neuron

AWS Neuron is seeking a Software Engineer to join their Machine Learning Applications team, focusing on the development of cloud-scale ML accelerators. This role combines software engineering with machine learning expertise, working on AWS Inferentia and Trainium platforms. The position involves developing and optimizing distributed training solutions for large language models like LLama3 and Mixtral, as well as other ML model families.

The role requires collaboration with chip architects and compiler engineers to build and enhance distributed training support in frameworks like PyTorch and JAX. You'll be responsible for performance tuning and maximizing efficiency of models running on AWS Trainium and Inferentia silicon. The team emphasizes work-life balance and offers significant opportunities for mentorship and career growth.

Amazon provides a comprehensive benefits package including medical coverage and financial benefits. The company strongly values diversity and inclusion, demonstrated through employee-led affinity groups and ongoing learning experiences. The team culture promotes knowledge sharing and professional development, with projects assigned to help team members grow their skills and tackle increasingly complex challenges.

Working at AWS Neuron means being at the forefront of machine learning infrastructure, developing solutions that power some of the most advanced AI models. The role offers competitive compensation based on geographic location and experience, along with equity and additional benefits as part of the total compensation package.

Last updated 7 hours ago

Responsibilities For Software Engineer- AI/ML, AWS Neuron

  • Development, enablement and performance tuning of ML model families
  • Building distributed training support into PyTorch and JAX
  • Tuning models for performance on AWS Trainium and Inferentia silicon
  • Working with chip architects, compiler engineers and runtime engineers
  • Creating and building distributed training solutions with Trn1

Requirements For Software Engineer- AI/ML, AWS Neuron

Python
  • 3+ years of non-internship professional software development experience
  • 2+ years of system design/architecture experience
  • Experience programming with at least one software programming language
  • Experience with Python and distributed training libraries
  • Strong software development and ML knowledge

Benefits For Software Engineer- AI/ML, AWS Neuron

Medical Insurance
401k
Mental Health Assistance
  • Work-life balance
  • Flexible working hours
  • Mentorship opportunities
  • Career growth opportunities
  • Medical benefits
  • Financial benefits

Interested in this job?

Jobs Related To Amazon Software Engineer- AI/ML, AWS Neuron