Taro Logo

Senior Staff Software Engineer, TPU Performance

Google is a global technology company that develops and provides a wide range of internet-based services and products.
$248,000 - $349,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Job Description

Google Cloud is seeking a Senior Staff Software Engineer to join their ML, Systems, & Cloud AI (MSCA) organization, focusing on TPU Performance. This role is critical in developing next-generation technologies for Google's ML infrastructure. The position involves working on advanced machine learning systems, particularly focusing on TPU (Tensor Processing Unit) performance optimization and architecture. The role combines software engineering expertise with machine learning infrastructure development, requiring deep understanding of high-performance computing and ML frameworks.

The successful candidate will work on cutting-edge projects involving large language models, ML framework optimization, and hardware-software co-design. They will be part of a team that designs and implements infrastructure used by billions of users through Google services and Google Cloud. The position offers the opportunity to work on challenging problems in ML acceleration, system architecture, and performance optimization.

This role at Google offers competitive compensation including a base salary range of $248,000-$349,000 plus bonus, equity, and comprehensive benefits. The position is based in Sunnyvale, CA, and requires expertise in performance modeling, ML optimization, and large-scale distributed systems. The role combines technical leadership with hands-on development, making it ideal for experienced engineers passionate about advancing ML infrastructure and performance optimization.

Google provides a collaborative environment where engineers can work on impactful projects while having opportunities for growth and development. The position requires both technical depth in ML systems and the ability to work across teams to drive innovation in ML acceleration and performance optimization.

Last updated 3 days ago

Responsibilities For Senior Staff Software Engineer, TPU Performance

  • Explore and define future ML accelerator system and chip architecture with objective and insights
  • Enable the cost effective performance of future ML systems with full stack ML Hardware-Software co-design
  • Establish understanding of the latest business-critical production ML models to inform optimizations
  • Develop Simulator technologies to keep up with evolving new system architecture choices and new ML workloads

Requirements For Senior Staff Software Engineer, TPU Performance

  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development
  • 5 years of experience testing, and launching software products
  • 5 years of experience in designing and implementing large-scale distributed systems

Benefits For Senior Staff Software Engineer, TPU Performance

Medical Insurance
401k
Equity
  • bonus
  • equity
  • benefits package

Related Jobs

Staff Software Engineer, BigQuery, Generative AI

Staff Software Engineer position at Google focusing on BigQuery and Generative AI, developing large-scale ML solutions and innovative data analytics services.

Staff Software Engineer, AI/ML, Google Workspace

Lead AI/ML software engineering role at Google Workspace, focusing on developing next-generation AI features for productivity tools, requiring extensive ML and leadership experience.

Staff Software Engineer, AI/ML GenAI, Google Workspace

Lead AI/ML initiatives for Google Workspace, developing Generative AI features for Google Slides and collaborating with DeepMind teams to shape the future of productivity tools.

Staff Software Engineer, Tech Lead, Gemini

Lead technical initiatives for Google's Gemini project as a Staff Software Engineer, focusing on machine learning and AI applications while managing team development and implementation.

Senior Staff Software Engineer, AI Data

Senior Staff Software Engineer position at Google focusing on AI Data systems and infrastructure, offering competitive compensation and the opportunity to work on cutting-edge GenAI technologies.