Senior Software Architect - Deep Learning and HPC Communications

NVIDIA is the world leader in accelerated computing, pioneering GPU technology and AI solutions.
Santa Clara, CA, USAWestford, MA 01886, USAAustin, TX, USA
$184,000 - $356,500
Staff Software Engineer
Hybrid
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS

Description For Senior Software Architect - Deep Learning and HPC Communications

NVIDIA, the pioneer of GPU technology and leader in accelerated computing, is seeking a Senior Software Architect to join their GPU Communications Libraries and Networking team. This role focuses on building crucial communication libraries like NCCL, NVSHMEM, and UCX for scaling Deep Learning and HPC applications.

The position involves working with cutting-edge technology in AI and High Performance Computing, where applications run at scales of up to tens of thousands of GPUs. You'll be responsible for co-designing next-gen data center platforms and developing scalable communications software that directly impacts end-to-end application performance.

As a Senior Software Architect, you'll work with high-speed interconnects like NVLink and PCIe within nodes and high-speed networking across nodes. This is an opportunity to advance state-of-the-art technology, break performance barriers, and deliver unprecedented platforms. The role requires expertise in parallel programming, system architecture, and network protocols.

The ideal candidate will have 5+ years of experience, advanced degree in Computer Science or related field, and strong programming skills in C/C++. Knowledge of AI frameworks, HPC applications, and communication runtimes is crucial. The position offers competitive compensation ($184,000-$356,500) plus equity and benefits.

Working at NVIDIA means joining a diverse, innovative team that's transforming industries through AI and accelerated computing. The company provides opportunities to work on groundbreaking projects that bridge hardware and software domains, making significant impacts in artificial intelligence and high-performance computing.

Last updated an hour ago

Responsibilities For Senior Software Architect - Deep Learning and HPC Communications

  • Investigate opportunities to improve communication performance by identifying bottlenecks in today's systems
  • Design and implement new communication technologies to accelerate AI and HPC workloads
  • Explore innovative solutions in HW and SW for next generation platforms
  • Build proofs-of-concept, conduct experiments, and perform quantitive modeling
  • Use simulation to explore performance of large GPU clusters

Requirements For Senior Software Architect - Deep Learning and HPC Communications

Linux
Python
  • M.S./Ph.D. degree in CS/CE or equivalent experience
  • 5+ years of relevant experience
  • Excellent C/C++ programming and debugging skills
  • Experience with parallel programming models (MPI, SHMEM)
  • Deep understanding of operating systems, computer and system architecture
  • Solid fundamentals of network architecture, topology, algorithms
  • Strong experience with Linux
  • Ability to work and communicate effectively in a multi-national environment

Benefits For Senior Software Architect - Deep Learning and HPC Communications

Equity
  • Equity and comprehensive benefits package

Interested in this job?

Jobs Related To NVIDIA Senior Software Architect - Deep Learning and HPC Communications

Senior Software Architect - GPU Fabric Networking

Senior Software Architect position at NVIDIA focusing on GPU Fabric Networking, offering $184K-$356.5K salary plus equity, requiring 10+ years of system architecture experience.

Senior High-Performance System Architect

Senior High-Performance System Architect role at NVIDIA focusing on Infiniband and NVL systems architecture for advanced compute clusters and AI research.

Software Advanced Developer

Advanced Software Developer role at NVIDIA focusing on networking and distributed computing research for data center environments.

Senior Network Algorithms Architect

Senior Network Algorithms Architect position at NVIDIA focusing on developing advanced networking solutions for AI infrastructure, requiring 8+ years of experience and strong algorithmic expertise.

Senior Software Architect - GPU Fabric Networking

Senior Software Architect position at NVIDIA focusing on GPU Fabric Networking, offering $184K-$356.5K salary plus equity, requiring 10+ years of system architecture experience.