Taro Logo

Principal Engineer, Core ML Infra, Training and Experimentation

Google is a global technology company that provides a wide range of internet-related services and products.
$294,000 - $414,000
Machine Learning
Principal Software Engineer
In-Person
5,000+ Employees
15+ years of experience
AI · Enterprise SaaS

Job Description

Google's Core ML team, part of the AI and Infrastructure organization, is seeking a Principal Engineer to lead their Training & Experimentation initiatives. This role sits at the intersection of Google's AI infrastructure and product development, focusing on making ML excellence accessible both within Google and globally.

The position involves leading the design and development of Core ML training, bulk inference, and experimentation infrastructure. You'll be responsible for driving technical strategy and roadmap across the training ecosystem, working closely with researchers, applied ML leads, and product UTLs to develop the best ML bulk inference and experimentation ecosystem.

As a Principal Engineer, you'll be instrumental in extending Google's leadership position in AI and driving ML velocity efforts across the company. The role requires deep technical expertise in systems and software, coupled with strong leadership skills and the ability to reason about technical impacts and risks.

The position offers a competitive compensation package ranging from $294,000 to $414,000 base salary, plus bonus, equity, and comprehensive benefits. You'll be working from one of Google's main tech hubs - Mountain View, San Francisco, or Sunnyvale, CA.

This is an exceptional opportunity for a seasoned technical leader with 15+ years of software engineering experience and strong ML infrastructure knowledge. You'll be at the forefront of Google's AI initiatives, working with cutting-edge technologies and helping shape the future of machine learning infrastructure at scale.

The role combines technical leadership with hands-on engineering, requiring both deep technical expertise and the ability to influence and guide teams. You'll be responsible for making critical technical decisions that impact Google's AI capabilities while working with some of the brightest minds in the field.

If you're passionate about machine learning infrastructure, have a proven track record of technical leadership, and want to make a significant impact on how AI is developed and deployed at scale, this role offers the perfect platform to advance your career while contributing to groundbreaking technological advancements.

Last updated 7 hours ago

Responsibilities For Principal Engineer, Core ML Infra, Training and Experimentation

  • Provide leadership in designing and implementing user-friendly, high-performance experimentation, bulk inference stack, and ecosystem for research and Google products
  • Work cross-functionally with Google Research and the Product team to design developer solutions
  • Develop a structure of other technical leads in the area, by defining technical goals and orienting teams around decisions
  • Provide leadership in firefighting situations or situations that require complex and immediate triaging
  • Act as a senior reviewer or go-to person for large-scale changes or technical decision-making

Requirements For Principal Engineer, Core ML Infra, Training and Experimentation

Python
  • Bachelor's degree in Computer Science, similar technical field of study, or equivalent practical experience
  • 15 years of professional experience as a software engineer
  • Experience with ML technologies and infrastructure with regard to training, bulk inference, and experimentation
  • Experience with technical innovation in one or more relevant domains (e.g. AI/ML)

Benefits For Principal Engineer, Core ML Infra, Training and Experimentation

Medical Insurance
  • Bonus
  • Equity
  • Medical Insurance

Related Jobs

Distinguished Engineer, DevAI Foundations and Applications

Lead Google's DevAI initiative as Distinguished Engineer, driving AI-assisted software development transformation through Gemini model integration and developer tooling innovation.

Distinguished Engineer, AI for Google Internal Developer Platforms

Distinguished Engineer position leading AI initiatives for Google's internal developer platforms, focusing on technical vision and strategy.

Senior Staff Software Engineer, AI/ML, Google Cloud

Senior Staff Software Engineer position at Google Cloud, focusing on AI/ML development and technical leadership, offering competitive compensation and opportunity to work on cutting-edge technology.

Senior Staff Software Engineer, AI/ML GenAI, Google Workspace

Senior Staff Software Engineer position at Google focusing on AI/ML GenAI integration in Google Workspace products, requiring 8+ years of software development experience and deep expertise in ML infrastructure.

Senior Staff Software Engineer, AI/ML, Google Cloud AI

Senior Staff Software Engineer position at Google Cloud AI, focusing on developing and optimizing large-scale AI infrastructure and solutions, with competitive compensation and benefits.