Taro Logo

Senior Software Architect - Deep Learning and HPC Communications

NVIDIA is the world leader in accelerated computing, pioneering GPU technology and AI solutions.
Santa Clara, CA, USAWestford, MA 01886, USAAustin, TX, USA
$184,000 - $356,500
Staff Software Engineer
Hybrid
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Senior Software Architect - Deep Learning and HPC Communications

NVIDIA, the pioneer in GPU technology and AI solutions, is seeking a Senior Software Architect to join their GPU Communications Libraries and Networking team. This role focuses on building crucial communication libraries like NCCL, NVSHMEM, and UCX for scaling Deep Learning and HPC applications. The position involves co-designing next-generation data center platforms and developing scalable communications software that powers systems running thousands of GPUs.

The ideal candidate will work at the intersection of hardware and software, designing and implementing new communication technologies to accelerate AI and HPC workloads. They will be responsible for investigating performance bottlenecks, exploring innovative solutions, and conducting experiments to evaluate new technologies. This role requires expertise in parallel programming, system architecture, and network communications.

Working at NVIDIA means being at the forefront of groundbreaking developments in Artificial Intelligence, High Performance Computing, and Visualization. The company's work enables revolutionary advancements in various fields, from deep learning to autonomous vehicles. This position offers the opportunity to work on cutting-edge technology that shapes the future of computing while collaborating with industry experts in a global environment.

The role comes with competitive compensation, including a base salary range of $184,000 - $356,500, plus equity and comprehensive benefits. Join NVIDIA to be part of a team that's pushing the boundaries of what's possible in GPU computing and communication technologies.

Last updated 7 days ago

Responsibilities For Senior Software Architect - Deep Learning and HPC Communications

  • Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems
  • Design and implement new communication technologies to accelerate AI and HPC workloads
  • Explore innovative solutions in HW and SW for next generation platforms
  • Build proofs-of-concept, conduct experiments, and perform quantitive modeling
  • Use simulation to explore performance of large GPU clusters

Requirements For Senior Software Architect - Deep Learning and HPC Communications

Linux
  • M.S./Ph.D. degree in CS/CE or equivalent experience
  • 5+ years of relevant experience
  • Excellent C/C++ programming and debugging skills
  • Experience with parallel programming models (MPI, SHMEM)
  • Deep understanding of operating systems, computer and system architecture
  • Solid fundamentals of network architecture, topology, algorithms
  • Strong experience with Linux
  • Ability to work and communicate effectively in a multi-national environment

Interested in this job?

Jobs Related To NVIDIA Senior Software Architect - Deep Learning and HPC Communications