Staff Software Engineer, Machine Learning Runtime, Google Cloud

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
$189,000 - $284,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Customer Engineer, AI Infrastructure, Google Cloud

Senior technical role combining AI infrastructure expertise with customer engineering, focusing on helping businesses optimize AI solutions using Google Cloud's advanced hardware and software capabilities.

Staff Software Engineer, Large Language Model and GenAI

Staff Software Engineer position at Google focusing on Large Language Models and GenAI development for Pixel devices, combining ML expertise with mobile platform development.

Manufacturing Test Development Engineering Lead, Machine Learning

Lead Manufacturing Test Development Engineering position at Google, focusing on machine learning hardware testing and development with competitive compensation and benefits.

Applied AI Engineering Lead, Core Enterprise, Core

Lead AI engineering role at Google focusing on applying machine learning solutions to enterprise problems across various domains.

Kaggle Staff Software Engineer, AI/ML

Staff Software Engineer position at Google's Kaggle team, focusing on AI/ML infrastructure and benchmarking, offering competitive compensation and the opportunity to shape the future of AI evaluation.

Description For Staff Software Engineer, Machine Learning Runtime, Google Cloud

Google is seeking a Staff Software Engineer to join their Machine Learning Runtime team in Google Cloud. This role is part of the Core team, which builds the technical foundation behind Google's flagship products. As a Staff Software Engineer, you'll be at the forefront of developing and optimizing machine learning infrastructure that powers Google's diverse ML ecosystem.

The position offers a compelling opportunity to work on critical projects that impact Google's technical direction across the company. You'll be responsible for leading the design and implementation of specialized ML solutions, managing framework migrations, and optimizing ML infrastructure. The role requires deep expertise in machine learning technologies, particularly in areas such as TensorFlow, JAX, and PyTorch runtimes.

Working at Google means joining a team that builds essential building blocks for excellent, safe, and coherent user experiences while driving innovation for every developer. The Core team has a unique mandate to impact important technical decisions across the company, breaking down technical barriers and strengthening existing systems.

The compensation package is highly competitive, with a base salary range of $189,000-$284,000, plus additional benefits including bonus and equity opportunities. Google offers a comprehensive benefits package and is committed to building a diverse, inclusive workplace where all employees can thrive.

This role is perfect for experienced engineers who are passionate about machine learning infrastructure and want to make a significant impact at scale. You'll work with cutting-edge technologies, lead cross-functional teams, and help shape the future of Google's ML ecosystem. The position requires strong technical leadership skills, extensive experience in ML infrastructure, and the ability to drive complex projects from conception to completion.

If you're excited about solving complex technical challenges, leading high-impact projects, and working with a team that influences Google's technical direction, this role offers an exceptional opportunity to advance your career while making a meaningful contribution to Google's ML infrastructure.

Last updated 4 months ago

Responsibilities For Staff Software Engineer, Machine Learning Runtime, Google Cloud

  • Provide technical leadership on high-impact projects
  • Manage project priorities, deadlines, and deliverables
  • Facilitate alignment and clarity across teams on goals, outcomes, and timelines
  • Lead the design and implementation of solutions in specialized ML areas
  • Optimize ML infrastructure and guide development of model optimization
  • Migrate existing frameworks runtimes from TPU to GPU
  • Support Google's diverse ML ecosystem needs

Requirements For Staff Software Engineer, Machine Learning Runtime, Google Cloud

Python
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development, and with data structures/algorithms
  • 5 years of experience testing, and launching software products
  • 3 years of experience with software design and architecture
  • 5 years of experience with speech/audio, reinforcement learning, ML infrastructure, or other ML field
  • 5 years of experience leading ML design and optimizing ML infrastructure

Benefits For Staff Software Engineer, Machine Learning Runtime, Google Cloud

Medical Insurance
Vision Insurance
Dental Insurance
Parental Leave
  • Bonus
  • Equity
  • Benefits package

Interested in this job?