Taro Logo

Senior Software Engineer - NIM Production and Automation

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins technology.
Ho Chi Minh City, VietnamHanoi, Vietnam
Backend
Senior Software Engineer
In-Person
5,000+ Employees
6+ years of experience
AI · Enterprise SaaS

Job Description

NVIDIA is seeking a Senior Software Engineer to join their team working on NVIDIA Inference Microservices (NIMs) and its deployed services. This role is crucial in developing components used by the software factory automation, focusing on providing high-performance inferencing for AI models. The position involves working with containerized applications, developing automation tools, and ensuring optimal performance of distributed systems.

The role combines technical expertise in software engineering with a focus on AI infrastructure. You'll be working on creating and optimizing containerized inference execution systems, developing automation applications, and ensuring the scalability of microservices. The position requires strong programming skills in Python and Go, extensive experience with container technologies like Docker and Kubernetes, and a deep understanding of CI/CD practices.

As a senior engineer, you'll not only be building systems but also mentoring team members and collaborating across organizational boundaries. The role offers the opportunity to work with cutting-edge AI technologies while being part of NVIDIA, a leader in accelerated computing. The company is known for tackling challenging problems in AI and digital twins, transforming major industries.

This position is perfect for someone who combines strong technical skills with leadership abilities and has a passion for building scalable, high-performance systems. You'll be working in either Ho Chi Minh City or Hanoi, Vietnam, contributing to NVIDIA's mission of advancing AI computing capabilities. The role offers the chance to work with some of the most forward-thinking professionals in the technology industry while developing solutions that impact the future of AI infrastructure.

Last updated a day ago

Responsibilities For Senior Software Engineer - NIM Production and Automation

  • Design and build containerized inference execution for AI applications
  • Develop automation applications and microservices supporting the NIM factory
  • Ensure performance, scalability, and availability of NIMs and automation infrastructure
  • Implement and manage CI/CD pipelines
  • Optimize container and orchestration systems
  • Collaborate with cross-functional teams
  • Mentor team members

Requirements For Senior Software Engineer - NIM Production and Automation

Python
Go
Kubernetes
  • BS or MS in Computer Science, Computer Engineering, or related field or equivalent experience
  • 6+ years of experience in developing performant microservices, cloud software, and/or tooling roles
  • Advanced programming skills in Python, Go
  • Experience with containerized applications using Docker, Kubernetes, Cloud Endpoints, Helm, and Prometheus
  • Experience productionizing and deploying AI models
  • Experience implementing CI/CD pipelines
  • Experience debugging and analyzing distributed microservices performance
  • Excellent interpersonal skills

Related Jobs

Senior Systems Software Engineer, Metropolis Blueprints

Senior Systems Software Engineer role at NVIDIA focusing on AI platform development, requiring 7+ years of experience in software engineering and machine learning.

System Test Design Engineer

Senior System Test Design Engineer position at NVIDIA, focusing on test automation and optimization for network products, requiring 5+ years of experience in software development and hardware testing.

Senior Java Engineer-Listed Company

Senior Java Engineer position at Compass, working remotely from Vietnam, focusing on backend development and API creation with competitive USD-based compensation.

Senior Full-stack Developer : Laravel + React

Senior Full Stack Developer position at AesthetiDocs, building SaaS solutions for aesthetic clinics using Laravel and React. 4+ years experience required, remote work available.

Senior Java API Engineer

Senior Java API Engineer position for banking industry client, focusing on backend development with 6+ years experience required. Hybrid work model with comprehensive benefits.