Taro Logo

Staff Software Engineer, Core Data ML Infrastructure

Google is a global technology company that builds innovative products and services used by billions of users.
$197,000 - $291,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Staff Software Engineer, Core Data ML Infrastructure

Google's Information Retrieval Embeddings Platform team is seeking a Staff Software Engineer to lead the development of their hosted solution for computing and serving embeddings models at scale. This role is part of Google's Core team, which builds the technical foundation behind Google's flagship products. The platform integrates multiple systems including inference services, data processing pipelines, and experimentation frameworks, serving critical teams like Search, News, Discover, YouTube, and DeepMind.

The position requires deep expertise in machine learning infrastructure, distributed systems, and software architecture. You'll be working on systems that are fundamental to Google's AI capabilities, specifically focusing on embeddings as a supported data type across the IR stack. The role involves close collaboration with client teams, infrastructure optimization, and innovative solution development.

This is an excellent opportunity for an experienced engineer who wants to make a significant impact on Google's technical infrastructure. The position offers competitive compensation including base salary, bonus, equity, and comprehensive benefits. You'll be working with cutting-edge technology in areas like generative AI, vector databases, and large-scale distributed systems.

The ideal candidate will have strong technical skills in C++, SQL, and distributed systems, combined with the ability to lead technical initiatives and collaborate across teams. This role offers the chance to work on technology that powers some of Google's most important products while helping to shape the future of AI infrastructure.

Last updated 3 days ago

Responsibilities For Staff Software Engineer, Core Data ML Infrastructure

  • Collaborate with client and partner teams to define and achieve product requirements/needs
  • Partner with infrastructure teams to ensure cost-effectiveness, low latency, and development of essential features
  • Design, prototype, experiment, and orchestrate innovative embeddings-related developer journeys
  • Integrate IR embeddings technology within client-specific GenAI/LLM applications
  • Lead the development of indexing and serving infrastructure, performance optimization, and custom solutions

Requirements For Staff Software Engineer, Core Data ML Infrastructure

  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development
  • 3 years of experience with software design and architecture
  • Experience building and developing large-scale infrastructure, distributed systems or networks
  • Experience with Machine Learning Infrastructure
  • Experience working with C++, Flume and SQL

Benefits For Staff Software Engineer, Core Data ML Infrastructure

Medical Insurance
Equity
401k
  • Medical Insurance
  • Equity
  • 401k

Interested in this job?

Jobs Related To Google Staff Software Engineer, Core Data ML Infrastructure