Senior AI Software Engineer, GenAI Framework

NVIDIA is seeking a Senior AI Software Engineer to join their team working on NeMo, an open-source framework for Large Language Models (LLM), Multimodal (MM), and Speech AI. This is a critical role where you'll be at the forefront of expanding NeMo Framework's capabilities, enabling developers to build and optimize state-of-the-art AI models.

The position offers an opportunity to work with cutting-edge AI technology at NVIDIA, widely recognized as one of the most desirable employers in the technology sector. You'll be responsible for designing and implementing new features, defining robust APIs, and optimizing performance for large-scale AI training and inference challenges.

The role requires strong expertise in Python programming and deep learning fundamentals, with at least 5 years of industry experience. You'll be working with AI frameworks like PyTorch and JAX, and dealing with deployment environments such as TRT, ONNX, and Triton. The position offers competitive compensation between $148,000 - $287,500 USD, plus equity and benefits.

Key responsibilities include developing the GenAI open source NeMo Framework and Megatron Core, solving end-to-end AI training challenges, and performance tuning of deep learning frameworks. You'll collaborate with internal partners, users, and the open source community to implement highly optimized solutions.

Ideal candidates will have expertise in large-scale AI training, understanding of GPU/CPU architecture, experience with cloud computing, and prior work with Generative AI techniques. NVIDIA values creativity and autonomy, offering an environment where you can make significant contributions to the field of AI while working with some of the most forward-thinking professionals in the industry.

The position is based in either Santa Clara, CA or Redmond, WA, and offers the opportunity to work on projects that are transforming the world's largest industries through AI and digital twins. NVIDIA is committed to fostering a diverse work environment and is an equal opportunity employer, making this an excellent opportunity for those looking to make an impact in the field of AI and machine learning.