Senior Software Engineer, TensorRT-LLM

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins technology.
$184,000 - $356,500
Machine Learning
Senior Software Engineer
Hybrid
5,000+ Employees
2+ years of experience
AI

Description For Senior Software Engineer, TensorRT-LLM

NVIDIA is seeking a Senior Software Engineer for their TensorRT-LLM team, focusing on developing cutting-edge inferencing software for AI and deep learning applications. This role sits at the intersection of AI innovation and high-performance computing, where you'll be working on technology that powers breakthroughs in LLM, ChatGPT, and Generative AI.

The position offers an opportunity to work with NVIDIA, a global leader in accelerated computing and AI technology. You'll be part of a fast-paced, delivery-focused team developing software that's foundational to both NVIDIA's product lines and the broader industry. The role involves crafting scalable inferencing software, conducting performance optimization, and staying current with the latest developments in artificial intelligence.

As a Senior Software Engineer, you'll collaborate with software, research, and product teams across NVIDIA, helping shape the direction of machine learning inferencing. The position requires strong technical expertise in C/C++ programming, deep learning frameworks like TensorFlow and PyTorch, and a solid understanding of AI/ML concepts.

The compensation package is highly competitive, with a base salary range of $184,000 to $356,500 USD, plus equity and benefits. NVIDIA offers a collaborative work environment, exposure to state-of-the-art technology, and the chance to contribute to groundbreaking AI advancements. The company values diversity and maintains an inclusive workplace culture, making it an ideal setting for professionals looking to make a significant impact in the AI field.

Last updated 5 days ago

Responsibilities For Senior Software Engineer, TensorRT-LLM

  • Craft and develop robust inferencing software that can be scaled to multiple platforms for functionality and performance
  • Performance analysis, optimization and tuning
  • Closely follow academic developments in the field of artificial intelligence and feature update TensorRT
  • Collaborate across the company to guide the direction of machine learning inferencing, working with software, research and product teams

Requirements For Senior Software Engineer, TensorRT-LLM

Python
  • Masters or higher degree in Computer Engineering, Computer Science, Applied Mathematics or related computing focused degree (or equivalent experience)
  • 2+ years of relevant software development experience
  • Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design
  • Strong curiosity about artificial intelligence, awareness of the latest developments in deep learning like LLMs, generative and recommender models
  • Experience working with deep learning frameworks like TensorFlow and PyTorch
  • Proactive and able to work without supervision
  • Excellent written and oral communication skills in English

Benefits For Senior Software Engineer, TensorRT-LLM

Equity
  • Equity

Interested in this job?

Jobs Related To NVIDIA Senior Software Engineer, TensorRT-LLM

Deep Learning Performance Architect

Senior Deep Learning Performance Architect position at NVIDIA, focusing on AI workload optimization and hardware architecture analysis, requiring 2+ years of experience in parallel computing.

AI Computing Software Development Engineer, TensorRT

Senior AI Software Engineer role at NVIDIA developing TensorRT inferencing software, requiring 3+ years experience and expertise in C++, deep learning frameworks, and AI technologies.

Senior Software Engineer, Deep Learning Inference, TensorRT

Senior Software Engineer position at NVIDIA working on TensorRT deep learning inference framework, focusing on high-performance GPU acceleration.

Deep Learning Performance Architect

Senior Deep Learning Performance Architect role at NVIDIA, focusing on optimizing deep learning kernels and developing GPU-accelerated AI software solutions.

Senior Software Engineer - Conversational AI

Senior Software Engineer role at NVIDIA focusing on building next-generation Multimodal Conversational AI systems using Speech and LLM models.