Taro Logo

Sr. Machine Learning Engineer, GenAI Innovation Center

AWS is the world's most comprehensive and broadly adopted cloud platform, pioneering cloud computing and continuous innovation.
$151,300 - $261,500
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Job Description

The Generative AI Innovation Center at AWS is at the forefront of empowering customers to leverage innovative AI technologies for transformative business opportunities. As a Senior Machine Learning Engineer, you'll be part of a multidisciplinary team working on cutting-edge LLM development and optimization.

Your role will involve designing and implementing distributed training pipelines for Large Language Models using advanced tools like Fully Sharded Data Parallel (FSDP) and DeepSpeed. You'll be responsible for adapting and fine-tuning LLMs for various applications, including new languages, domains, and vision applications, while also implementing Reinforcement Learning with Human Feedback (RLHF).

A key aspect of the role involves optimizing AI models for AWS's custom silicon (Inferentia and Trainium) using the AWS Neuron SDK and developing custom kernels for enhanced performance. You'll work directly with enterprise customers and foundational model providers to understand their challenges and co-develop tailored generative AI solutions.

AWS values diverse experiences and work-life harmony. The company offers comprehensive benefits, mentorship opportunities, and a strong focus on career growth. You'll be part of AWS Global Services, working alongside technical experts across dozens of countries to help customers achieve more with AWS cloud.

The role requires significant experience in software development, AI/ML technologies, and leadership capabilities. You'll be joining a team that's driving innovation in generative AI while working with top AWS clients to deliver next-generation AI solutions. The position offers competitive compensation and benefits, with opportunities to work on challenging problems at scale.

Last updated 5 days ago

Responsibilities For Sr. Machine Learning Engineer, GenAI Innovation Center

  • Design and implement distributed training pipelines for LLMs
  • Adapt LLMs for new languages, domains, and vision applications
  • Optimize AI models for deployment on AWS Inferentia and Trainium
  • Interact with enterprise customers and foundational model providers
  • Develop custom kernels for enhanced performance

Requirements For Sr. Machine Learning Engineer, GenAI Innovation Center

Python
  • 5+ years of non-internship professional software development experience
  • 5+ years of programming with at least one software programming language
  • 5+ years of leading design or architecture experience
  • Experience as a mentor, tech lead or leading an engineering team
  • Experience with design, development, and optimization of generative AI solutions
  • Current, active US Government Security Clearance of TS/SCI or above

Benefits For Sr. Machine Learning Engineer, GenAI Innovation Center

Medical Insurance
401k
  • Work-life balance
  • Mentorship and career growth opportunities
  • Employee-led affinity groups
  • Inclusive team culture