Software Engineer - Generative AI, AGIF | Runtime Services

Join Amazon's cutting-edge Generative AI team to advance state-of-the-art technology that will benefit all Amazon businesses and customers. As a Software Development Engineer, you'll work with a talented team of engineers and scientists in a highly collaborative environment. The role focuses on building best-in-class, fast, accurate, and cost-efficient large language model inference solutions and infrastructure.

Your responsibilities will include designing and implementing high-performance inference capabilities, working with multi-modality and SOTA model architectures, and optimizing for latency, throughput, and cost. You'll have the opportunity to read research papers, experiment with new algorithms, and implement production-grade solutions. The position requires close collaboration with scientists and other engineering teams.

The role offers competitive compensation ranging from $129,300 to $223,600 based on location, plus equity and other benefits. You'll be part of Amazon's mission to push the boundaries of Generative AI technology while working with some of the most advanced AI systems. This is an excellent opportunity for someone passionate about AI/ML who wants to make a significant impact at scale.

The ideal candidate should have strong software development experience, knowledge of machine learning and deep learning, and a track record of performance optimization. Experience with Large Language Model inference, GPU programming, and Python/C++ development is highly valued. You'll be expected to maintain high standards in operational excellence and continuously innovate to improve system efficiency.