Taro Logo

Staff Software Engineer, Core Data ML Infrastructure

Google builds the technical foundation behind Google's flagship products, developing platforms, components and infrastructure used across the company.
$197,000 - $291,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Staff Software Engineer, Core Data ML Infrastructure

Google is seeking a Staff Software Engineer to join their Core Data ML Infrastructure team, focusing on the Information Retrieval Embeddings Platform. This platform is a critical hosted solution for computing and serving embeddings models at scale, used by major Google products including Search, News, Discover, YouTube, and DeepMind.

The role involves working on sophisticated infrastructure that integrates multiple systems including inference services, data processing pipelines, experimentation frameworks, and ScaM. The platform orchestrates data flow between these systems and provides comprehensive monitoring capabilities. The team is making embeddings a supported data type across the IR stack and enabling self-service journeys for prototyping, experimentation, and production.

As a Staff Software Engineer, you'll be part of the Core team that builds the technical foundation behind Google's flagship products. The team owns and advocates for underlying design elements, developer platforms, product components, and infrastructure. This position offers a unique opportunity to impact important technical decisions across the company and break down technical barriers while strengthening existing systems.

The ideal candidate will have extensive experience in software development, particularly in machine learning infrastructure and large-scale distributed systems. They should be proficient in C++, Flume, and SQL, with additional knowledge of generative AI and vector databases being highly valuable. The role offers competitive compensation including base salary, bonus, equity, and comprehensive benefits.

This is an excellent opportunity for a senior engineer looking to work on cutting-edge machine learning infrastructure that powers some of Google's most important products and services. The position combines technical leadership with hands-on development work, requiring both strategic thinking and deep technical expertise.

Last updated 2 days ago

Responsibilities For Staff Software Engineer, Core Data ML Infrastructure

  • Collaborate with client and partner teams to define and achieve product requirements/needs for launches and ongoing enhancements
  • Partner with infrastructure teams to ensure cost-effectiveness, low latency, and the development of essential features and capabilities
  • Design, prototype, experiment, and orchestrate innovative embeddings-related developer journeys
  • Integrate IR embeddings technology within client-specific GenAI/LLM applications
  • Lead the development of indexing and serving infrastructure, performance optimization, and custom solutions

Requirements For Staff Software Engineer, Core Data ML Infrastructure

  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development
  • 3 years of experience with software design and architecture
  • Experience building and developing large-scale infrastructure, distributed systems or networks
  • Experience with Machine Learning Infrastructure
  • Experience working with C++, Flume and SQL

Benefits For Staff Software Engineer, Core Data ML Infrastructure

Medical Insurance
Equity
401k
  • Medical Insurance
  • Equity
  • 401k

Interested in this job?

Jobs Related To Google Staff Software Engineer, Core Data ML Infrastructure