Senior Staff Engineer, Cloud Machine Learning Compute Systems

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information.
$248,000 - $349,000
Machine Learning
Staff Software Engineer
Contact Company
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS · Cloud
This job posting may no longer be active. You may be interested in these related jobs instead:
Customer Engineer, AI Infrastructure, Google Cloud

Senior technical role combining AI infrastructure expertise with customer engineering, focusing on helping businesses optimize AI solutions using Google Cloud's advanced hardware and software capabilities.

Staff Software Engineer, Large Language Model and GenAI

Staff Software Engineer position at Google focusing on Large Language Models and GenAI development for Pixel devices, combining ML expertise with mobile platform development.

Manufacturing Test Development Engineering Lead, Machine Learning

Lead Manufacturing Test Development Engineering position at Google, focusing on machine learning hardware testing and development with competitive compensation and benefits.

Applied AI Engineering Lead, Core Enterprise, Core

Lead AI engineering role at Google focusing on applying machine learning solutions to enterprise problems across various domains.

Kaggle Staff Software Engineer, AI/ML

Staff Software Engineer position at Google's Kaggle team, focusing on AI/ML infrastructure and benchmarking, offering competitive compensation and the opportunity to shape the future of AI evaluation.

Description For Senior Staff Engineer, Cloud Machine Learning Compute Systems

Google Cloud is seeking a Senior Staff Engineer to lead their Machine Learning Compute Systems initiatives. This role combines deep technical expertise in machine learning optimization with system-level engineering. You'll be working on critical projects that impact how billions of users interact with Google's technologies, focusing on optimizing ML models for performance, efficiency, and accuracy. The position offers the opportunity to work with cutting-edge technology in cloud computing and machine learning, while solving complex technical challenges at massive scale.

As a Senior Staff Engineer, you'll be responsible for developing and implementing sophisticated optimization strategies for machine learning models, working with custom kernels, and leveraging deep learning frameworks like JAX. The role requires expertise in both the theoretical and practical aspects of machine learning systems, including model architecture design, hyperparameter optimization, and hardware-level optimizations.

Google Cloud serves customers in over 200 countries, providing enterprise-grade solutions that leverage Google's cutting-edge technology. This position offers competitive compensation ($248,000-$349,000 + bonus + equity + benefits) and the opportunity to work with world-class engineers and researchers. The ideal candidate will combine technical excellence with leadership qualities, bringing fresh ideas to areas including distributed computing, system design, and artificial intelligence.

Working at Google means being part of a company that values diversity, inclusion, and innovation. You'll have the chance to impact billions of users while working with the latest technologies in machine learning and cloud computing. The role offers significant growth opportunities and the ability to influence the direction of Google's machine learning infrastructure.

Last updated a month ago

Responsibilities For Senior Staff Engineer, Cloud Machine Learning Compute Systems

  • Advise to optimize machine learning models for speed, memory efficiency, and accuracy through experimentation with different architectures, hyper-parameters, and optimization techniques
  • Accelerate model training and inference by identifying and implementing software and hardware optimizations, which may include profiling code, optimizing data pipelines
  • Improve model performance for specific customer use cases by developing and implementing custom kernels (e.g., CUDA, XLA)
  • Showcase a strong understanding of deep learning frameworks such as JAX, including the ability to debug, extend, and optimize them
  • Translate customer requirements into technical solutions by working closely with them to understand their needs

Requirements For Senior Staff Engineer, Cloud Machine Learning Compute Systems

Python
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in optimizing machine learning models
  • Experience writing custom kernels (CUDA, XLA, etc.)
  • Excellent programming skills in Python, C/C++

Benefits For Senior Staff Engineer, Cloud Machine Learning Compute Systems

Medical Insurance
Dental Insurance
Vision Insurance
Equity
401k
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • Equity
  • 401k

Interested in this job?