Software Engineer- AI/ML, AWS Neuron

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the Trn1 and Inf1 servers. This role is for a senior software engineer in the Machine Learning Applications (ML Apps) team, focusing on development, enablement and performance tuning of various ML model families including large language models.

The position involves:

• Working with chip architects, compiler engineers and runtime engineers
• Creating and tuning distributed training solutions with Trn1
• Building distributed training support into PyTorch and JAX using XLA
• Optimizing performance for AWS Trainium and Inferentia silicon
• Working with cutting-edge ML models like LLama3, Mixtral, DBRX

The team offers:

• Strong focus on work-life balance with flexible working hours
• Inclusive culture with employee-led affinity groups
• Mentorship and career growth opportunities
• Collaborative environment with knowledge sharing
• Comprehensive benefits including medical, financial, and equity

This is a key role combining software development expertise with machine learning knowledge, perfect for someone passionate about high-performance ML systems and distributed computing.