Taro Logo

Machine Learning Hardware Architect, Google Cloud

Google is a global technology company that designs and develops cloud computing, search, software, and online advertising technologies.
$156,000 - $229,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS · Cloud
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Machine Learning Hardware Architect, Google Cloud

Google Cloud is seeking a Machine Learning Hardware Architect to shape the future of AI/ML hardware acceleration, specifically focusing on TPU (Tensor Processing Unit) technology. This role combines advanced computer architecture with machine learning expertise, requiring deep understanding of both hardware design and ML frameworks.

The position involves developing cutting-edge TPU architecture that powers Google's most demanding AI/ML applications. You'll work on optimizing accelerator performance under power constraints, developing transaction-level models, and streamlining host-accelerator interactions. The role requires collaboration with various teams including XLA compiler, Platforms performance, and system design teams.

As part of the ML, Systems, & Cloud AI (MSCA) organization, you'll contribute to the infrastructure supporting all Google services and Google Cloud. The work impacts billions of users through products like Google Cloud's Vertex AI and various Google services. The role offers competitive compensation including base salary, bonus, equity, and comprehensive benefits.

The ideal candidate should have strong experience in computer architecture and hardware design, coupled with software development skills in C++ or Python. Knowledge of ML frameworks like TensorFlow and PyTorch is highly valued, as is understanding of the ML market and technological trends. This position offers an opportunity to work at the intersection of hardware architecture and machine learning, driving innovation in AI acceleration technology.

Working at Google provides exposure to cutting-edge technology and the chance to impact global-scale systems. The role combines technical depth with broad system-level thinking, requiring collaboration across multiple specialized teams to deliver comprehensive solutions for AI hardware acceleration.

Last updated 2 months ago

Responsibilities For Machine Learning Hardware Architect, Google Cloud

  • Create differentiated architectural innovations for Google's semiconductor TPU roadmap
  • Evaluate the power, performance, and cost of prospective architecture and subsystems
  • Collaborate with partners in Hardware Design, Software, Compiler, ML Model and Research teams for hardware/software co-design
  • Work on Machine Learning (ML) workload characterization and benchmarking
  • Develop architecture for differentiating features on next generation TPUs

Requirements For Machine Learning Hardware Architect, Google Cloud

Python
  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, a related field, or equivalent practical experience
  • 5 years of experience in computer architecture, chip architecture, IP architecture, co-design, performance analysis, or hardware design
  • Experience in developing software systems in C++ or Python

Benefits For Machine Learning Hardware Architect, Google Cloud

Medical Insurance
401k
Equity
  • Bonus
  • Equity
  • Benefits package