Software Engineer II - AI/ML, AWS Neuron

Amazon is a global technology company that provides cloud computing, artificial intelligence, e-commerce, and digital streaming services.
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For Software Engineer II - AI/ML, AWS Neuron

AWS Neuron is seeking a Software Engineer II to join their Machine Learning Applications team, focusing on the complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators. This role combines software engineering expertise with machine learning, working on state-of-art GEN-AI models and large language models.

The position offers an opportunity to work alongside chip architects and compiler engineers, optimizing performance and accuracy of cutting-edge AI models. You'll be responsible for developing AI toolchains and automating ML techniques for model evaluation and debugging. The role requires strong C++/Python programming skills and deep ML knowledge.

The team values work-life balance and offers flexible working hours, allowing you to establish a healthy flow between personal and professional life. You'll join a collaborative environment that celebrates knowledge sharing and mentorship, with opportunities for career growth through challenging projects and supportive senior team members.

Amazon offers competitive compensation ranging from $129,300 to $223,600 based on location and experience, plus equity and comprehensive benefits. This role is perfect for engineers passionate about AI/ML who want to impact the future of cloud computing while working with industry-leading technology at scale.

The position is based in Seattle, WA, where you'll work with a diverse team dedicated to pushing the boundaries of machine learning acceleration. Join AWS Neuron to shape the future of AI infrastructure while growing your career in a supportive, innovative environment.

Last updated 2 months ago

Responsibilities For Software Engineer II - AI/ML, AWS Neuron

  • Lead efforts in building distributed inference support into PyTorch using XLA
  • Work with Neuron compiler and runtime stacks
  • Identify optimization opportunities through comparative analysis
  • Develop and automate solutions for AI accelerator accuracy
  • Develop deep AI toolchains

Requirements For Software Engineer II - AI/ML, AWS Neuron

Python
  • 3+ years of programming using modern programming languages like Java, C++, or C#
  • 3+ years of leading design or architecture experience
  • 3+ years of full software development life cycle experience
  • Fundamentals of Machine learning and deep learning models
  • Experience with model execution optimization

Benefits For Software Engineer II - AI/ML, AWS Neuron

Medical Insurance
401k
  • Work-life balance
  • Flexible working hours
  • Mentorship & Career Growth

Jobs Related To Amazon Software Engineer II - AI/ML, AWS Neuron

Machine Learning Engineer, Generative AI Innovation Center - Model Customization

Machine Learning Engineer role at AWS Generative AI Innovation Center focusing on LLM development, model customization, and optimization for enterprise AI solutions.

Software Engineer- AI/ML, AWS Neuron

Software Engineer role at AWS Neuron developing distributed training solutions for machine learning accelerators, focusing on large language models and ML infrastructure optimization.

Software Development Engineer, JWO

Software Development Engineer position at Amazon's JustWalkOut team, developing AI infrastructure for checkout-free retail technology.

Product Quality Engineer (AI Solutions), Private Brands

Product Quality Engineer role at Amazon combining traditional quality management with AI implementation, focusing on improving product quality through innovative technology solutions.

Software Development Engineer, Communications and Corporate Responsibility, Operations and Technology

Software Development Engineer role at Amazon focusing on building AI-powered media intelligence and brand management solutions, offering competitive compensation and the opportunity to work with cutting-edge technologies.