Taro Logo

Staff Software Engineer, ML Performance

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
$197,000 - $291,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI

Description For Staff Software Engineer, ML Performance

Google is seeking a Staff Software Engineer to join their Machine Learning (ML) Performance team, focusing on optimizing performance for machine learning and AI workloads at scale. This role combines deep technical expertise in ML systems with performance engineering to drive efficiency across Google's ML infrastructure.

The position involves working with cutting-edge ML technologies and frameworks, including TensorFlow, JAX, and TPU hardware. You'll be responsible for identifying and maintaining benchmarks for both LLM and non-LLM systems, implementing optimization strategies, and collaborating with product teams to solve complex performance challenges.

The ideal candidate will bring extensive experience in software development, performance analysis, and ML systems. You'll work on projects that impact billions of users, optimizing trillion-parameter multipod ML models and contributing to Google's success in MLPerf competitions.

This role offers competitive compensation ($197,000-$291,000 base salary plus bonus and equity) and the opportunity to work at one of tech's most innovative companies. You'll be part of a team that's pushing the boundaries of ML performance and efficiency, working on problems that directly impact Google's ability to deliver cutting-edge AI solutions.

The position is based in either Mountain View, Kirkland, or Seattle, offering the chance to work with world-class engineers in Google's main tech hubs. You'll have access to Google's extensive resources and be part of a culture that values technical excellence, innovation, and collaboration.

Last updated 3 days ago

Responsibilities For Staff Software Engineer, ML Performance

  • Identify and maintain LLM/non-LLM training and serving benchmarks
  • Work on scaling partitioning and algorithmic optimizations to Google products and ML models
  • Engage with Google product teams to solve their LLM performance problems
  • Analyze performance and efficiency metrics to identify bottlenecks, design, and implement solutions at Google fleet-wide scale

Requirements For Staff Software Engineer, ML Performance

Python
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in testing, and launching software products
  • 5 years of experience with software development in one or more programming languages (e.g., Python, C, C++)
  • 3 years of experience in performance analysis including system architecture, performance, benchmarking and machine learning infrastructure

Benefits For Staff Software Engineer, ML Performance

Medical Insurance
Equity
  • Bonus
  • Equity
  • Comprehensive benefits package

Interested in this job?

Jobs Related To Google Staff Software Engineer, ML Performance