Taro Logo

Principal Architect, AI Networking

NVIDIA is the world leader in accelerated computing, pioneering AI and digital twins technology to transform industries.
$272,000 - $425,500
Principal Software Engineer
Hybrid
5,000+ Employees
12+ years of experience
AI

Job Description

NVIDIA, a pioneer in computer graphics and accelerated computing for over 25 years, is seeking a Principal Architect for AI Networking to join their innovative team. This role sits at the intersection of AI infrastructure and networking technology, focusing on developing cutting-edge solutions for AI systems at scale. The position offers an opportunity to shape the future of AI networking by working on NVIDIA Dynamo, KV cache management, and large-scale inference systems.

The ideal candidate will bring deep expertise in both AI systems and networking, with the ability to co-design software and hardware solutions. You'll be working with state-of-the-art technology, collaborating across hardware architecture, software architecture, and research teams to build innovative networking solutions that power the next generation of AI infrastructure.

This is a unique opportunity to join a company that's at the forefront of AI and accelerated computing, where your work will directly impact the development of technologies that are transforming industries worldwide. NVIDIA offers a competitive compensation package, including a base salary range of $272,000 - $425,500 USD, equity, and comprehensive benefits.

The role combines deep technical expertise with strategic thinking, requiring someone who can not only architect complex systems but also collaborate effectively across diverse teams. You'll be part of a supportive environment that values innovation and technical excellence, working on projects that push the boundaries of what's possible in AI networking.

If you're passionate about solving complex technical challenges, have a strong background in AI systems and networking, and want to be part of a team that's defining the future of computing, this role offers an exceptional opportunity to make a lasting impact in the field of AI technology.

Last updated a day ago

Responsibilities For Principal Architect, AI Networking

  • Work on accelerating NVIDIA Dynamo - KV cache management and large-scale inference
  • Develop and research groundbreaking networking technologies to advance and scale AI networks
  • Co-design software and hardware networking solutions across various networking related domains
  • Work closely with hardware architecture, software architecture, and research teams
  • Lead the development of prototypes that optimize AI training and inference infrastructure

Requirements For Principal Architect, AI Networking

Rust
  • Master's or Ph.D. in Computer Science, Electrical or Computer Engineering from a top-tier university
  • 12+ years of relevant academic or proven experience in the field
  • Comprehensive understanding of AI workloads and their impact on network infrastructure
  • Strong proficiency in Machine Learning/Deep Learning fundamentals
  • Skilled in C or C++ for systems software development
  • Curiosity for building leading edge technology
  • Ability to work and communicate effectively across diverse teams

Benefits For Principal Architect, AI Networking

Equity
  • Equity
  • Competitive Benefits Package

Related Jobs