Sr. Software Engineer- AI/ML, AWS Neuron Apps

World's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$151,300 - $261,500
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Sr. Software Engineer- AI/ML, AWS Neuron Apps

AWS Neuron is seeking a Senior Software Engineer to join their Machine Learning Applications (ML Apps) team. This role focuses on developing and optimizing AWS's complete software stack for cloud-scale machine learning accelerators. You'll work with cutting-edge ML technologies, including large language models and vision transformers, while collaborating with chip architects and compiler engineers.

The position offers an opportunity to shape the future of machine learning infrastructure at AWS, working with technologies like PyTorch, TensorFlow, and distributed training libraries. You'll be responsible for performance tuning and optimization of ML models on AWS's custom silicon (Inferentia and Trainium).

AWS, as part of Amazon's Utility Computing organization, is at the forefront of cloud innovation, providing foundational services like S3 and EC2. The role combines deep technical expertise in software engineering with machine learning knowledge, making it ideal for someone passionate about both fields.

The company offers a strong emphasis on work-life harmony, with flexible working arrangements and a supportive culture. Amazon's commitment to diversity is evident through various employee-led affinity groups and ongoing learning experiences. Career growth is facilitated through mentorship programs and knowledge-sharing opportunities.

The compensation package is competitive, ranging from $151,300 to $261,500 based on location, plus equity and comprehensive benefits. This role represents an opportunity to work on cutting-edge ML infrastructure while being part of AWS's mission to be Earth's Best Employer.

Key technical aspects include working with distributed training frameworks, optimizing large language models, and developing solutions for AWS's custom ML accelerators. The ideal candidate will combine strong software development skills with deep ML knowledge to drive innovation in cloud-based machine learning infrastructure.

Last updated 10 hours ago

Responsibilities For Sr. Software Engineer- AI/ML, AWS Neuron Apps

  • Development, enablement and performance tuning of ML model families
  • Work with large language models like GPT2, GPT3
  • Create, build and tune distributed training solutions with Trn1
  • Work with chip architects, compiler engineers and runtime engineers
  • Build distributed training and inference support into PyTorch, TensorFlow
  • Optimize model performance on AWS Trainium and Inferentia silicon

Requirements For Sr. Software Engineer- AI/ML, AWS Neuron Apps

Python
Java
  • 5+ years of programming using modern programming languages (Java, C++, or C#)
  • 5+ years of leading design or architecture experience
  • 5+ years of full software development life cycle experience
  • Fundamentals of Machine learning and deep learning models
  • Experience with model architecture, training and inference lifecycles
  • Experience with Python and distributed training libraries

Benefits For Sr. Software Engineer- AI/ML, AWS Neuron Apps

Medical Insurance
401k
  • Work-life balance
  • Mentorship & Career Growth
  • Inclusive Team Culture
  • Employee-led affinity groups
  • Flexible working hours

Interested in this job?

Jobs Related To Amazon Sr. Software Engineer- AI/ML, AWS Neuron Apps

Software Development Engineer, AGI Sensory ASR Inference

Senior Software Engineering role at Amazon's AGI team focusing on high-performance inference software development and AI system optimization.

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior Software Engineer position at AWS focusing on AI/ML distributed training solutions using AWS Neuron technology stack.

Sr. Software Engineer- AI/ML, AWS Neuron Distributed Training

Senior Software Engineer position for AWS Neuron Distributed Training team, focusing on AI/ML development for cloud-scale Machine Learning accelerators.

Sr. Software Engineer- AI/ML, AWS Neuron Apps

Senior Software Engineering role at AWS focusing on machine learning infrastructure and optimization for cloud-scale ML accelerators.

Sr. ML Compiler Engineer - Automated Reasoning Science, Annapurna Labs

Senior ML Compiler Engineer position at Amazon's AWS Neuron Compiler team, focusing on developing deep learning compiler stack and optimization tools for ML accelerators.