Taro Logo

Software Engineer - NIM Production and Automation

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins technology.
Ho Chi Minh City, VietnamHanoi, Vietnam
Backend
Mid-Level Software Engineer
In-Person
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Job Description

NVIDIA is seeking passionate Software Engineers to join their team building software factory automation and deployed services for NVIDIA Inference Microservices (NIMs). This role focuses on developing and maintaining components that ensure efficient production and deployment of AI models at scale. The position offers hands-on experience with cloud-native technologies, large-scale distributed systems, and AI development lifecycle. As part of the team, you'll work on containerized applications, microservices, and infrastructure automation, contributing to NVIDIA's cutting-edge AI inferencing technology. The role combines software development, cloud computing, and AI technologies, making it an excellent opportunity for engineers interested in working at the intersection of these fields. NVIDIA offers a collaborative environment where you'll work alongside experienced engineers while having the chance to impact the future of AI computing. The company is known for being one of the technology world's most desirable employers, with some of the most forward-thinking and creative people in the industry.

Last updated 17 days ago

Responsibilities For Software Engineer - NIM Production and Automation

  • Develop and deploy containerized applications and microservices in Python and Go
  • Build and optimize containerized inference execution for AI applications
  • Ensure performance and scalability of NIMs through testing and monitoring
  • Implement and maintain CI/CD pipelines
  • Work with container technologies and orchestration platforms
  • Support cloud services enhancement using Infrastructure as Code
  • Troubleshoot issues and debug code
  • Participate in team discussions and code reviews

Requirements For Software Engineer - NIM Production and Automation

Python
Go
Kubernetes
  • Bachelor's or Master's degree in Computer Science, Computer Engineering, or related field
  • 2+ years of software development experience
  • Solid programming fundamentals in Python or Go
  • Experience with version control and testing
  • Understanding of containerization and orchestration
  • Interest in cloud technologies and distributed systems
  • Good communication and collaboration skills
  • Familiar with deploying and using AI Models, LLM, VLM

Related Jobs

Software Engineer - NIM Production and Automation

Software Engineering role at NVIDIA focusing on AI infrastructure automation and microservices deployment, requiring 2+ years of experience in software development with Python/Go and container technologies.

Software Engineer

Software Engineering role at Microsoft working on Substrate Core team, building infrastructure for M365 Copilot and critical services, with focus on backend systems and AI integration.

Software Engineer

Software Engineer role at Microsoft building large-scale data ingestion services for Office365, focusing on distributed systems and data privacy.

Software Engineer 2 (Office Data Loader team)

Software Engineer 2 position at Microsoft's Office Data Loader team, building large-scale data ingestion services for Office365 with focus on privacy and compliance.

Java Software Engineer (Junior/Middle/Senior)

Java Software Engineer position at Floating Cube Studios in Ho Chi Minh City, focusing on backend development with Spring Boot and microservices architecture.