Taro Logo

Senior DL Algorithms Engineer - Inference Performance

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins technology.
$148,000 - $287,500
Machine Learning
Senior Software Engineer
Hybrid
5,000+ Employees
3+ years of experience
AI

Description For Senior DL Algorithms Engineer - Inference Performance

NVIDIA is seeking a Senior DL Algorithms Engineer to join their team in optimizing Deep Learning workloads. This role sits at the intersection of AI, hardware optimization, and software development, offering a unique opportunity to impact the future of AI computing.

The position requires expertise in deep learning, particularly in inference optimization, combined with a strong understanding of computer architecture and GPU technologies. You'll be working on delivering highly optimized deep learning solutions as part of NVIDIA's Inference Microservices (NIMs), while collaborating with cross-functional teams across hardware and software domains.

As part of NVIDIA's datacenter business, you'll play a crucial role in maximizing the performance of datacenter deployments and contributing to hardware design and system software development. The role involves working with state-of-the-art AI technologies, including LLMs, VLMs, and drug discovery models, while developing tools and processes to scale the delivery of optimized DL models.

The ideal candidate should have a PhD in Computer Science, Electrical Engineering, or related field (or equivalent experience), with at least 3 years of experience in the field. Strong programming skills in C++ and Python are essential, while GPU programming experience (CUDA or OpenCL) is a plus. The role offers competitive compensation, including a base salary range of $148,000 - $287,500 USD, plus equity and benefits.

NVIDIA is widely recognized as one of the technology world's most desirable employers, known for its innovative work in AI and accelerated computing. The company values creativity and autonomy, offering opportunities to work with some of the industry's most forward-thinking professionals. This role provides an excellent opportunity to directly impact hardware and software roadmaps in a fast-growing technology company that leads the AI revolution.

The position offers a blend of technical challenges and opportunities for growth, requiring expertise in performance analysis, optimization, and deep learning while working across various layers of the hardware/software stack. If you're passionate about pushing the boundaries of AI performance and want to work with cutting-edge technology, this role at NVIDIA could be your next career milestone.

Last updated 20 hours ago

Responsibilities For Senior DL Algorithms Engineer - Inference Performance

  • Deliver hyper-optimized recipes for DL inference as part of NVIDIA Inference Microservices (NIMs)
  • Analyze, validate and debug performance and accuracy characteristics of optimized models
  • Benchmark state-of-the-art offerings in various DL models inference
  • Develop software, tooling and processes across multiple layers of the stack
  • Collaborate with SW/HW co-design teams

Requirements For Senior DL Algorithms Engineer - Inference Performance

Python
Linux
  • PhD in CS, EE or CSEE or equivalent experience
  • 3+ years of experience
  • Experience with delivering results under tight timelines
  • Strong background in deep learning and neural networks
  • Deep understanding of computer architecture
  • Programming skills in C++ and Python

Benefits For Senior DL Algorithms Engineer - Inference Performance

Equity
  • Equity
  • Benefits package

Interested in this job?

Jobs Related To NVIDIA Senior DL Algorithms Engineer - Inference Performance

Senior Software Engineer, Robotics Foundation Models

Senior Software Engineer role at NVIDIA focusing on robotics foundation models, AI, and computer vision for humanoid robots.

Senior Software Engineer, Deep Learning Inference

Senior Software Engineer position at NVIDIA focusing on developing deep learning inference frameworks and optimizing LLM performance on NVIDIA GPUs.

Senior Software Engineer, Digital Human Technology

Senior Software Engineer position at NVIDIA focusing on Digital Human Technology, involving AI, machine learning, and high-performance computing.

Senior Deep Learning Software Engineer, Recipe Pathfinding

Senior Deep Learning Software Engineer role at NVIDIA focusing on optimizing LLM performance through innovative recipe pathfinding and software systems development.

Senior Software Engineer, Robotics Foundation Models

Senior Software Engineer position at NVIDIA focusing on robotics foundation models, combining AI and robotics to develop intelligent humanoid robot systems.