Taro Logo

Senior Software Engineer, Deep Learning Inference

World leader in accelerated computing, pioneering AI and digital twins to transform industries.
$148,000 - $287,500
Machine Learning
Senior Software Engineer
Hybrid
6+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Senior Software Engineer, Deep Learning Inference

NVIDIA, the world leader in accelerated computing, is seeking a Senior Software Engineer to join their TensorRT team. This role focuses on developing industry-leading deep learning inference software for NVIDIA AI accelerators. The position involves designing and implementing inference optimizations for real-time AI applications on personal computing devices with NVIDIA AI accelerators (GPU, DLA). Working closely with cross-functional teams, you'll integrate and deploy AI solutions in production environments. The role offers an opportunity to shape the performance, functionality, and efficiency of AI models and systems at a company that's at the forefront of AI innovation. You'll be working with cutting-edge technology, developing software in C++, Python, and CUDA to accelerate systems that enable seamless deployment of next-gen AI models. The position offers competitive compensation ranging from $148,000 to $287,500, plus equity and benefits. This is an excellent opportunity for experienced engineers passionate about AI and machine learning to make a significant impact in a collaborative, fast-paced environment.

Last updated 6 months ago

Responsibilities For Senior Software Engineer, Deep Learning Inference

  • Design, implement and optimize TensorRT components for Generative AI inference applications
  • Develop software in C++, Python, and CUDA for next-gen AI models
  • Collaborate with deep learning experts and GPU architects

Requirements For Senior Software Engineer, Deep Learning Inference

Python
  • BS, MS, PhD or equivalent experience in Computer Science, Computer Engineering or related field
  • 6+ years of software development experience on a large codebase
  • Strong proficiency in C++ and Python programming languages
  • Experience with Deep Learning Frameworks, Compilers, or System Software
  • Foundational knowledge of Machine Learning techniques or GPU optimizations
  • Excellent problem-solving skills
  • Strong communication skills

Benefits For Senior Software Engineer, Deep Learning Inference

Equity
  • Equity
  • Comprehensive benefits package

Interested in this job?