Taro Logo

Distinguished Engineer – Data Center System Software Architect

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins technology.
$308,000 - $471,500
Principal Software Engineer
Hybrid
5,000+ Employees
20+ years of experience
AI · Enterprise SaaS

Description For Distinguished Engineer – Data Center System Software Architect

NVIDIA, the world leader in accelerated computing, is seeking a Distinguished Engineer to architect data center system software for their DGX and HGX platforms. This role sits at the intersection of NVIDIA's cutting-edge hardware - including GPUs, NVLink, InfiniBand networking, and Grace CPUs - and their optimized AI and HPC software stack.

The position requires a seasoned architect with 20+ years of experience to own end-to-end system software architecture, from firmware to kernel drivers and operating systems. You'll collaborate with internal teams and engage directly with major cloud service providers to shape product direction and implementation.

The ideal candidate brings deep expertise in server system architecture, accelerator software, and management protocols. You'll drive critical technical decisions while mentoring future leaders and working with industry partners to advance NVIDIA's data center technology roadmap.

This role offers the opportunity to shape the future of AI and HPC infrastructure at one of tech's most innovative companies. You'll work on cutting-edge systems that power major cloud providers and enterprises, with competitive compensation including a base salary range of $308,000-$471,500 plus equity and benefits.

NVIDIA's data center systems are core to their rapidly growing enterprise business. As Distinguished Engineer, you'll be at the forefront of designing and implementing the software architecture that enables these powerful computing platforms. The role combines technical leadership, strategic planning, and hands-on architecture work in a collaborative environment focused on pushing the boundaries of accelerated computing.

Last updated 2 days ago

Responsibilities For Distinguished Engineer – Data Center System Software Architect

  • Drive the system architecture for complex server platforms in a cross functional environment
  • Work directly with major customers to understand requirements and align roadmaps
  • Work with business partners and vendors to shape their products
  • Develop roadmap of new technologies and protocols and drive their design and adoption
  • Mentor architects and engineering teams
  • Make key technical decisions and mitigate execution risks

Requirements For Distinguished Engineer – Data Center System Software Architect

Linux
  • Deep experience in designing architecture for scalable and performant server systems
  • Experience working with complex system software for accelerators (GPUs, DPUs, FPGAs)
  • Expertise in Out of Band and Inband management architectures
  • Knowledge of device management protocols (MCTP, PLDM, RDE)
  • Knowledge of system management protocols (Redfish, IPMI)
  • Experience working with platform security
  • Excellent written and verbal communication skills
  • BS or MS degree in Computer Engineering, Computer Science, or related degree
  • 20+ years in System architecture and design

Interested in this job?

Jobs Related To NVIDIA Distinguished Engineer – Data Center System Software Architect

Senior Software Architect - GPU Fabric Networking

Senior Software Architect position at NVIDIA focusing on GPU Fabric Networking, offering $184K-$356.5K salary plus equity, requiring 10+ years of system architecture experience.

Senior System Software Architect, HPC and AI Networking

Senior System Software Architect position at NVIDIA focusing on HPC and AI Networking, developing scalable systems for AI training and inference optimization.

Distinguished Engineer – Data Center System Software Architect

Lead system software architecture for NVIDIA's data center systems, working with cutting-edge GPU technology and major cloud providers. 20+ years experience required.

Distinguished Systems Software Engineer, Graphics Delivery Network Platform

Distinguished Systems Software Engineer role at NVIDIA focusing on cloud streaming platform development, combining GPU expertise with AI technologies and distributed systems architecture.

Distinguished Software Architect - Deep Learning and HPC Communications

Distinguished Software Architect position at NVIDIA focusing on Deep Learning and HPC Communications, requiring 15+ years experience and expertise in parallel computing and high-performance networking.