Staff Software Engineer, ML Performance

Google is seeking a Staff Software Engineer to join their Machine Learning (ML) Performance team, focusing on optimizing performance and efficiency for machine learning and AI workloads at massive scale. This role is critical in driving Google's ML performance through deep fleet-scale analysis and auto-optimizations.

The position requires expertise in machine learning systems, performance analysis, and software development. You'll work on cutting-edge projects involving LLM training and serving, scaling optimizations, and benchmarking for Google's ML infrastructure. The role involves collaboration with product teams to solve complex performance challenges and implement solutions that impact Google's entire fleet.

As a Staff Software Engineer, you'll be responsible for identifying and maintaining benchmarks used by the industry, working on scaling partitioning and algorithmic optimizations, and analyzing performance metrics to drive improvements. The role offers competitive compensation ($197,000-$291,000 + bonus + equity) and the opportunity to work with state-of-the-art ML technologies and frameworks.

This is an excellent opportunity for experienced engineers passionate about machine learning performance optimization and looking to make an impact at scale. You'll be working with Google's latest accelerators and contributing to the development of efficient ML systems that power Google's products used by billions of users worldwide.

The role is based in premier tech hubs (Mountain View, Kirkland, or Seattle) and offers the chance to work with talented teams across Google's organization. You'll be at the forefront of ML performance optimization, working on projects that push the boundaries of what's possible with machine learning technology.