Taro Logo

Senior Staff Software Engineer, GPU Performance, Google Scale

Google is a global technology company that develops cloud computing, search, software, and online advertising technologies.
$248,000 - $349,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Senior Staff Software Engineer, GPU Performance, Google Scale

Google Cloud is seeking a Senior Staff Software Engineer to lead GPU performance optimization efforts at Google scale. This role sits within the ML, Systems, & Cloud AI (MSCA) organization, which is responsible for the hardware, software, and infrastructure powering Google's services and Cloud offerings. The position focuses on optimizing GPU performance for machine learning workloads, working with cutting-edge GPU architectures, and developing solutions that impact billions of users.

The ideal candidate will have deep expertise in GPU architecture, compiler optimization, and machine learning infrastructure. They will work on critical projects involving OpenXLA, MLIR, and Triton, while collaborating with teams across Google to improve model performance and influence future GPU hardware designs. This role offers the opportunity to work with the latest GPU technologies and shape the future of accelerated computing at Google.

The position offers competitive compensation including a base salary range of $248,000-$349,000 plus bonus, equity, and comprehensive benefits. The role can be based in several major tech hubs including Sunnyvale, Kirkland, Mountain View, New York, or Austin, offering flexibility in location while working on some of the most challenging and impactful problems in GPU optimization and machine learning infrastructure.

This is a unique opportunity to work at the intersection of hardware and software, optimizing performance for Google's most critical AI and machine learning workloads while collaborating with world-class engineers and researchers. The role requires both deep technical expertise and the ability to lead and influence technical strategy across multiple teams and projects.

Last updated 14 days ago

Responsibilities For Senior Staff Software Engineer, GPU Performance, Google Scale

  • Help architect the future of accelerated computing
  • Build optimizations that improve benchmarks, and power Google's most critical products and services
  • Shape the entire GPU software stack through influencing model design, optimizing low-level kernels and compilers
  • Manage challenging performance bottlenecks and explore optimization techniques
  • Collaborate cross-functionally with machine learning, compiler design, and systems architecture teams

Requirements For Senior Staff Software Engineer, GPU Performance, Google Scale

Python
Kubernetes
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development
  • 7 years of experience leading technical project strategy, ML design, and working with industry-scale ML infrastructure
  • 5 years of experience testing, and launching software products
  • 3 years of experience with software design and architecture
  • Experience working with GPUs

Benefits For Senior Staff Software Engineer, GPU Performance, Google Scale

Medical Insurance
401k
Equity
Parental Leave
  • Medical Insurance
  • 401k
  • Equity
  • Parental Leave

Interested in this job?