Taro Logo

Senior Software Engineer - Automated Parallel Programming

NVIDIA is the world leader in accelerated computing, pioneering solutions for AI and digital twins.
Santa Clara, CA, USADurham, NC, USAHillsboro, OR, USA
$184,000 - $287,500
Backend
Senior Software Engineer
Hybrid
5,000+ Employees
4+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer - Automated Parallel Programming

NVIDIA's PyTorch Team is seeking a Senior Software Engineer to join their Automated Parallel Programming initiative. This role sits at the intersection of AI, parallel computing, and systems optimization, working on NVIDIA/Fuser (nvFuser) and the broader PyTorch ecosystem. The position offers the opportunity to work with cutting-edge technology and influence the future of GPU computing.

The role involves developing sophisticated code generation systems for machine learning frameworks, optimizing GPU performance, and collaborating with both hardware and software teams. You'll be working on tools used by millions of AI practitioners, making AI applications scalable to thousands of GPUs. The position requires expertise in parallel programming, particularly with NVIDIA's CUDA, and strong C++ development skills.

The ideal candidate will have advanced education in Computer Science or related fields, with significant experience in parallel programming and large-scale software development. Knowledge of deep learning compilers, distributed parallelism techniques, and contributions to major frameworks like PyTorch, TensorFlow, or similar systems are highly valued.

This is an opportunity to work with a diverse team at the forefront of AI and parallel computing, with competitive compensation including a base salary range of $184,000 - $287,500 USD, plus equity and benefits. The role offers the chance to influence not just software development but also future hardware design at NVIDIA, making it an exciting opportunity for those passionate about high-performance computing and AI.

Last updated 18 minutes ago

Responsibilities For Senior Software Engineer - Automated Parallel Programming

  • Craft a code generation system to accelerate portions of a graph collected from a machine learning framework
  • Partner with hardware and software teams to improve GPU performance in PyTorch
  • Design, build and support production AI solutions
  • Optimize performance of Deep Learning models for NVIDIA GPUs and systems
  • Collaborate with internal applied researchers to improve AI tools
  • Advise design of new hardware generations

Requirements For Senior Software Engineer - Automated Parallel Programming

Python
  • MS or PhD in Computer Science, Computer Engineering, Electrical Engineering or related field
  • Parallel programming experience with NVIDIA CUDA Programming Language or similar
  • 4+ years of experience with C++ programming
  • Demonstrated experience developing large software projects
  • Excellent verbal and written communication skills

Benefits For Senior Software Engineer - Automated Parallel Programming

Equity
  • Equity
  • Benefits package

Interested in this job?

Jobs Related To NVIDIA Senior Software Engineer - Automated Parallel Programming

Senior Software Engineer, Place and Route Tools

Senior Software Engineer position at NVIDIA focusing on developing advanced Place and Route Tools, combining C++, parallel computing, and machine learning to create industry-leading EDA solutions.

Senior Compiler Engineer - Backend

Senior Compiler Engineer position at NVIDIA focusing on GPU backend compiler development, offering competitive salary, equity, and opportunity to work on cutting-edge AI and graphics technology.

Senior System Software Engineer – Simulation and Virtualization

Senior System Software Engineer role at NVIDIA focusing on simulation and virtualization for data center platforms, requiring 5+ years of experience in C/C++, OS fundamentals, and virtualization technologies.

Senior Software Engineer, Hardware Tools and Methodology Development

Senior Software Engineer position at NVIDIA focusing on hardware tools and methodology development, combining C++ programming with RTL design expertise in Santa Clara, CA.

Senior Simulation Software Engineer

Senior Simulation Software Engineer role at NVIDIA developing C++ models and simulators for next-gen Ethernet switches, requiring 10+ years experience in firmware or embedded software.