Taro Logo

Senior AI and ML Engineer

NVIDIA is the world leader in accelerated computing, pioneering solutions in AI and digital twins that transform industries.
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Senior AI and ML Engineer

NVIDIA is seeking a Senior AI and ML Engineer to join their Infrastructure Planning and Process Team (IPP). This role sits at the intersection of AI and infrastructure, focusing on leveraging cutting-edge AI technologies to enhance NVIDIA's internal cloud infrastructure that supports various crucial teams including Graphics Processors, Mobile Processors, Deep Learning, and Driverless Cars divisions.

The position offers an exciting opportunity to work with NVIDIA's massive-scale infrastructure that processes nearly half a million automated jobs daily across five thousand servers. You'll be developing sophisticated AI and ML solutions, particularly focusing on large language models and agentic AI, to automate and optimize workflows for software development, DevOps, and SRE activities.

The ideal candidate will bring strong expertise in AI/ML/DL, particularly in working with LLMs and agentic AI, combined with solid software engineering skills in languages like Python, Go, or Java. You'll need to understand distributed systems, microservices architecture, and have experience with container technologies and database systems.

This role offers the opportunity to work at the forefront of AI technology, solving complex infrastructure challenges while contributing to NVIDIA's mission of transforming industries through AI and accelerated computing. You'll be part of a global team that's building the future of technology, with the chance to impact thousands of developers worldwide through your innovations.

Last updated a day ago

Responsibilities For Senior AI and ML Engineer

  • Implementing AI/ML/DL use cases to improve efficiency in SW development, DevOps and SRE workflows
  • Identify problems related to performance, utilization and scale in existing systems
  • Work with the architect and other developers in internal and external development teams
  • Develop tools and software solutions utilizing large language models and agentic AI
  • Automate workflows and enhance productivity of engineers across software development

Requirements For Senior AI and ML Engineer

Python
Go
Java
MongoDB
MySQL
  • BE (MS preferred) or equivalent experience in EE/CS with 5+ years of work experience
  • Well versed with Large Language Mode (LLM), Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL) algorithm and techniques
  • Hands-on experience in leveraging large language models (LLMs) and implementing agentic AI
  • Expert programming ability in Python, Go or Java
  • Experience in working with SQL/NoSQL database systems
  • Good understanding of distributed systems, microservice architecture and REST APIs
  • Excellent knowledge and working experience with Docker containers
  • Ability to effectively work across organizational boundaries

Interested in this job?

Jobs Related To NVIDIA Senior AI and ML Engineer