Taro Logo

Senior Staff Software Engineer, Google Cloud AI

Google is a global technology company that develops innovative products and services used by billions of users worldwide.
$248,000 - $349,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS · Cloud

Job Description

Google Cloud AI is seeking a Senior Staff Software Engineer to join their New Product Introduction (NPI) and Platform Readiness team within the AI Hypercomputer Infrastructure organization. This role is critical in bringing new Tensor Processing Unit (TPU) and Graphics Processing Unit (GPU) generations to the Google Cloud platform and enabling end-to-end AI/ML compute experiences for Google Cloud users.

The position involves working with cutting-edge AI technologies and infrastructure, helping to qualify and bring up the complete Cloud TPU and Cloud GPU Hypercomputer stack, including VMs, Networking, Storage, Google Kubernetes Engine (GKE), and software tool chains. The role requires building and delivering telemetry infrastructure for both GPU/TPU fleet and critical AI/ML workloads, while optimizing stability and performance for high-priority AI/ML applications.

As a Senior Staff Software Engineer, you'll be responsible for developing and executing multi-year plans for validating end-to-end stack for TPU and GPU Products, ensuring that products deliver performance and stability to make AI/ML customers successful. The role requires extensive expertise in distributed systems and machine learning, along with strong leadership abilities to build strategic technical alignment with major organizations across Google.

The position offers competitive compensation ranging from $248,000 to $349,000 plus bonus, equity, and comprehensive benefits. You'll be working in a collaborative environment, developing strong relationships across organizational boundaries with cross-functional teams to achieve the delivery of a high-performing end-to-end stack.

This is an excellent opportunity for experienced engineers who want to make a significant impact on Google Cloud's AI infrastructure and help shape the future of machine learning technologies. The role combines technical leadership, strategic planning, and hands-on engineering work in one of the most advanced AI computing environments in the industry.

Last updated 6 days ago

Responsibilities For Senior Staff Software Engineer, Google Cloud AI

  • Build and lead strategic technical alignment with major organizations across Google
  • Use expertise in distributed systems and machine learning to develop and execute multi-year plans
  • Ensure products deliver performance and stability for AI/ML customers
  • Develop collaborative relationships across organizational boundaries
  • Provide technical leadership and mentorship as an overall Über Tech Lead (UTL)

Requirements For Senior Staff Software Engineer, Google Cloud AI

Python
Java
Kubernetes
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development
  • 7 years of experience leading technical project strategy, ML design, and optimizing ML infrastructure
  • 5 years of experience with design and architecture and testing/launching software products
  • 5 years of experience with speech/audio, reinforcement learning, ML infrastructure, or specialization in another ML field

Benefits For Senior Staff Software Engineer, Google Cloud AI

Medical Insurance
Parental Leave
Equity
  • Bonus
  • Equity
  • Medical Insurance
  • Parental Leave