Software Development Engineer, Generation Runtime

The Artificial General Intelligence (AGI) Generation Runtime team at Amazon is seeking a highly-skilled Software Engineer to lead the development and implementation of cutting-edge technologies for efficient inference in Generative Artificial Intelligence (GenAI) models.

Key responsibilities include:

• Designing, developing, testing, and deploying inference solutions for state-of-the-art LLMs
• Creating scalable, fault-tolerant AI workflows optimized for cost and latency
• Building innovative technologies in a large distributed computing environment
• Developing solutions on AWS that are user-friendly, scalable, and manageable
• Collaborating with other engineers to solve GenAI problems
• Mentoring junior engineers and contributing to team growth
• Performing on-call duties to ensure exceptional customer experience
• Working in an agile environment to deliver high-quality software

The ideal candidate will have:

• 2+ years of professional software development experience
• Strong programming skills in languages like Java, C++, or C#
• Experience in software architecture and design
• Solid Computer Science fundamentals
• Knowledge of Machine Learning algorithms and techniques

Preferred qualifications include a Master's degree in Computer Science, 3+ years of complex software development experience, and familiarity with machine learning model workflows.

Join our open-minded team dedicated to innovating on behalf of our customers and pushing the boundaries of AI technology. We offer a diverse and inclusive work environment with opportunities for growth and development.