Senior LLM Systems Engineer, NeMo Microservices Platform

NVIDIA, a pioneer in accelerated computing for over 25 years, is seeking a Senior LLM Systems Engineer for their NeMo Microservice Platform team. This role is at the forefront of AI innovation, focusing on building primitives that enable software engineers to train and deploy AI at scale. The position involves developing distributed cloud applications, creating microservices for AI cloud services, and implementing core infrastructure for cloud-native AI evaluation.

The ideal candidate will have 5+ years of experience and strong expertise in Python programming, microservices architecture, and distributed systems. They'll work on cutting-edge LLM technology while contributing to all aspects of the machine learning lifecycle - from conceptualization to deployment.

NVIDIA offers a competitive base salary range of $148,000 - $287,500 USD, plus equity and benefits. The company is known for its diverse, supportive environment where innovation thrives. As part of the team, you'll have the opportunity to make a lasting impact on the world through AI technology advancement.

The role combines technical depth in cloud computing with AI expertise, requiring skills in HTTP REST, gRPC, protobuf, and JSON technologies. Experience with Rust or Golang is a plus. You'll be working independently, managing your own development efforts while collaborating with the open source community.

Join NVIDIA's team to help shape the future of AI computing, working on technology that powers computers, robots, and self-driving cars that can understand the world. This position offers the flexibility of multiple locations, including Santa Clara, CA and remote options across several US states.