Sr. Software Engineer- AI/ML, AWS Neuron Apps

AWS Neuron is Amazon's complete software stack for AWS Inferentia and Trainium cloud-scale machine learning accelerators and Trn1/Inf1 servers. This senior role focuses on developing and optimizing ML applications, particularly working with large language models like GPT2/GPT3 and vision models.

The position involves:

• Leading distributed inference support development in PyTorch and TensorFlow
• Performance tuning of ML models on AWS Trainium and Inferentia silicon
• Collaborating with chip architects and compiler engineers
• Working on distributed training solutions using FSDP and Deepspeed

The team emphasizes:

• Strong work-life balance with flexible working hours
• Supportive environment for new team members
• Focus on knowledge sharing and mentorship
• Career growth opportunities through challenging projects
• Thorough but constructive code reviews

The role combines deep ML expertise with strong software engineering, requiring both technical excellence and collaborative skills. You'll be at the forefront of optimizing cutting-edge ML models for AWS's specialized hardware.

Compensation ranges from $151,300 to $261,500 per year based on location, plus equity and comprehensive benefits including medical, financial, and other perks.