Software Development Engineer II, ML_AI

World's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$129,300 - $223,600
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS · Cloud

Description For Software Development Engineer II, ML_AI

AWS Utility Computing (UC) is at the forefront of cloud innovation, providing foundational services like S3 and EC2. This role is specifically within Amazon SageMaker AI, focusing on making deep learning workloads in the cloud accessible and efficient. As customers increasingly adopt LLMs and Generative AI, we're building the next-generation AI platform to accelerate their development.

As an SDE II, you'll be instrumental in designing and implementing distributed machine learning systems that serve our global customer base. You'll work directly with ML engineers, scientists, and customers on training cutting-edge AGI and Amazon Q models. The role combines technical expertise with leadership, as you'll be responsible for system architecture decisions and mentoring junior engineers.

The position requires strong technical abilities, particularly in Python, TypeScript, and multi-threaded asynchronous C++/Go development. Experience with resource orchestrators like Kubernetes, high-performance computing, or large language model training is highly valued. You'll be working on building platform and products for large-scale deep learning model training, handling models with 100+ billion parameters across thousands of GPU devices.

AWS offers a comprehensive benefits package, including medical and financial benefits, along with significant opportunities for career growth and mentorship. The company strongly values work-life harmony and maintains an inclusive culture through employee-led affinity groups and ongoing learning experiences.

This is an opportunity to join a team that's directly impacting AWS's future and the broader cloud computing industry. You'll be working with cutting-edge AI technology while collaborating with internal teams, leading technology companies, and the open-source community. The role offers competitive compensation ranging from $129,300 to $223,600 based on location and experience, plus additional benefits and equity opportunities.

Last updated 2 hours ago

Responsibilities For Software Development Engineer II, ML_AI

  • Design, develop, test, and deploy distributed machine learning systems
  • Build large-scale solutions for world-wide customer base
  • Collaborate with ML engineers/scientists and customers to train AGI and Amazon Q models
  • Gather and analyze business and functional requirements
  • Translate requirements into technical specifications
  • Drive system architecture
  • Implement best practices for quality
  • Coach and develop junior engineers
  • Build and improve next-generation AI platform
  • Collaborate with internal teams and leading technology companies

Requirements For Software Development Engineer II, ML_AI

Python
TypeScript
Go
Kubernetes
  • 3+ years of non-internship professional software development experience
  • 2+ years of non-internship design or architecture experience
  • Experience programming with at least one software programming language
  • Experience in python, typescript and multi-threaded asynchronous C++/Go development
  • Experience in resource orchestrators like slurm/kubernetes, high performance computing, building scalable systems, or large language model training

Benefits For Software Development Engineer II, ML_AI

Medical Insurance
401k
  • Medical benefits
  • Financial benefits
  • Mentorship and career growth opportunities
  • Work-life harmony
  • Employee-led affinity groups
  • Inclusive culture

Interested in this job?

Jobs Related To Amazon Software Development Engineer II, ML_AI

Software Engineer - Generative AI, AGIF | Runtime Services

Software Engineering role at Amazon focusing on Generative AI and large language model inference solutions, offering competitive compensation and the opportunity to work with cutting-edge AI technology.

Software Development Engineer II - DSO, Demand Science Optimization (DSO)

Software Development Engineer II position at Amazon's DSO team, focusing on ML-powered demand forecasting and supply management for Amazon Devices.

SDE II (Machine Learning), AGI Foundations

ML Engineer position at Amazon's AGI team focusing on LLM training and development, offering competitive salary and benefits in California locations.

Software Engineer- AI/ML, AWS Neuron

Software Engineer position at AWS Neuron team, focusing on ML infrastructure development and optimization for cloud-scale machine learning accelerators.

Software Engineer- AI/ML, AWS Neuron Machine Learning Distributed Training, ML Accuracy

Senior Software Engineer position at AWS Neuron team, focusing on distributed ML training systems and optimization for cloud-scale machine learning accelerators.