Senior System Software Architect, HPC Networking

NVIDIA is seeking a highly motivated Senior System Software Architect for HPC Networking to join their team of experts in shaping the future of high-performance and ML/AI computing. The role involves working on next-generation Ethernet, InfiniBand, and NVLink systems that power advanced compute clusters and supercomputers.

Key responsibilities include:

• Creating proofs-of-concept for AI Frameworks, runtime designs, and network hardware features
• Researching and implementing features for AI and HPC communication middleware and Deep Learning frameworks
• Designing and developing hardware features for scientific, Deep Learning, and data-intensive workloads
• Collaborating with customers to understand needs and provide innovative solutions

Requirements:

• Ph.D., Masters, or Bachelors in computer science, computer engineering, electrical engineering, or related field
• 5+ years of experience in DNNs, Scaling of DNNs, Parallelism of DNN frameworks, or deep learning training workloads
• Deep understanding of parallelism techniques
• Experience with AI network parallelism using collective libraries and RDMA/RoCE
• Strong programming and software development skills

Preferred qualifications:

• Deep understanding of technology and passion for the field
• Strong collaborative and interpersonal skills
• Background in designing communication middleware for high-performance computing systems
• Experience with CUDA programming and NVIDIA GPUs

NVIDIA offers a diverse work environment and is an equal opportunity employer. The position is hybrid, allowing for flexibility in work arrangements. Join NVIDIA to work on innovative technology driving the world forward in AI, HPC, and accelerated computing.