Taro Logo

Distinguished Engineer – Data Center System Software Architect

NVIDIA is the world leader in accelerated computing, pioneering GPU technology and AI solutions.
$308,000 - $471,500
Principal Software Engineer
In-Person
5,000+ Employees
20+ years of experience
AI · Enterprise SaaS

Job Description

NVIDIA is seeking a Distinguished Engineer to lead the architecture of their data center systems, including DGX and HGX platforms. This role combines NVIDIA's cutting-edge GPU technology, NVLink, InfiniBand networking, and Grace CPUs with their AI and HPC software stack. The position requires a seasoned architect to oversee end-to-end system software architecture, from firmware to user mode drivers.

The role involves direct engagement with major cloud service providers and internal teams to shape next-generation data center products. The ideal candidate will bring 20+ years of experience in system architecture, deep technical expertise in server systems, and proven leadership in complex cross-functional projects.

NVIDIA, known as "the AI computing company," invented the GPU in 1999, revolutionizing parallel computing and modern computer graphics. The company is at the forefront of deep learning and AI advancement, with their technology powering computers, robots, and self-driving cars that can perceive and understand the world.

The position offers a competitive salary range of $308,000 - $471,500 USD, plus equity and benefits. This is an opportunity to work with forward-thinking professionals and contribute to groundbreaking developments in AI, High-Performance Computing, and Visualization at a company that's leading technological advancement in these fields.

The role requires expertise in system firmware, embedded systems, Linux kernel internals, and various management protocols. The successful candidate will influence product direction through direct customer engagement, drive technology adoption, and make critical technical decisions while managing risk through left-shift strategies.

Last updated 5 hours ago

Responsibilities For Distinguished Engineer – Data Center System Software Architect

  • Serve as primary technical point of contact for major customers
  • Lead technical innovation and strategic collaborations with hyperscalers
  • Align NVIDIA's roadmap with major customers' requirements
  • Develop and drive adoption of new technologies and protocols
  • Make critical technical decisions in ambiguous situations

Requirements For Distinguished Engineer – Data Center System Software Architect

Linux
Kubernetes
  • Deep expertise in scalable and performant server system architecture
  • Extensive experience with complex system software for accelerators
  • Mastery of system firmware and Linux kernel internals
  • Proficiency in Out-of-Band and In-Band management architectures
  • Extensive knowledge of networking technologies and protocols
  • BS or MS degree in Computer Science, Electrical Engineering or related field
  • 20+ years in System architecture and design

Benefits For Distinguished Engineer – Data Center System Software Architect

Equity
  • Equity

Related Jobs

Distinguished Software Engineer - NVLink Fusion Software

Lead the development of NVIDIA's NVLink Fusion software architecture, enabling industry-leading AI scale-up and scale-out performance with NVIDIA technology and semi-custom ASICs/CPUs.

Distinguished Engineer - Rack System Software

Distinguished Engineer position at NVIDIA focusing on rack system software architecture, requiring 16+ years of experience in system architecture and design.

Distinguished Engineer, Apache Spark

Lead the architecture and implementation of GPU-accelerated Apache Spark at NVIDIA, working with distributed systems and open source communities to revolutionize data processing performance.

Principal Architect, AI Networking

Principal Architect position at NVIDIA focusing on AI Networking, developing cutting-edge solutions for large-scale AI infrastructure and networking systems.

Distinguished Software Architect - Deep Learning and HPC Communications

Distinguished Software Architect position at NVIDIA focusing on Deep Learning and HPC Communications, requiring expertise in distributed systems and GPU architecture.