Principal Engineer, Platform and Scale, Vertex AI

Google Cloud provides enterprise-grade solutions leveraging cutting-edge technology, helping organizations digitally transform across 200+ countries.
Machine Learning
Principal Software Engineer
In-Person
5,000+ Employees
15+ years of experience
AI · Enterprise SaaS · Cloud

Description For Principal Engineer, Platform and Scale, Vertex AI

Google Cloud is seeking a Principal Engineer to lead the Vertex Generative AI Serving platform, a crucial component in delivering cutting-edge AI experiences across Google Cloud's global user base. This role combines technical leadership with strategic vision, requiring 15 years of software engineering leadership experience and deep expertise in generative AI technologies.

The position involves leading a multi-site engineering organization responsible for the performance, reliability, and efficiency of generative AI models in production. You'll collaborate with Vertex platform teams, Google research, and CoreML teams to build and enhance the LM serving platform. The role demands both technical excellence and strategic leadership, including setting technical direction, defining operational standards, and driving platform adoption.

As a Principal Engineer, you'll shape the future of Google Cloud's AI infrastructure, working with cutting-edge technologies like LLMs and diffusion models. The position offers the opportunity to impact AI development at a global scale, working with teams across Google's ecosystem. You'll be instrumental in determining how AI technologies are deployed and utilized across Google Cloud's extensive customer base.

The ideal candidate combines deep technical expertise with strong leadership abilities, capable of inspiring teams and driving innovation in AI technology. You'll need to balance technical decisions with business strategy, ensuring the platform meets both current needs and future scalability requirements. This role offers the chance to work at the forefront of AI technology while leading and mentoring teams across multiple locations.

Working at Google Cloud means joining a team that's transforming how businesses operate through technology. You'll be part of an organization that values diversity, innovation, and technical excellence, with the opportunity to shape the future of AI infrastructure at a global scale.

Last updated 15 days ago

Responsibilities For Principal Engineer, Platform and Scale, Vertex AI

  • Own and set the strategic roadmap, resource allocation, execution and delivery through critical technology choices
  • Define operational excellence standards and lead strategic partnerships within Google
  • Lead a growing engineering organization across multiple sites
  • Determine the performance, reliability, and efficiency of Generative AI models in production
  • Lead, collaborate, and influence across Vertex platform teams, Google research and CoreML teams
  • Evolve the strategic direction for the organization
  • Provide executive leadership to define product vision, roadmap, and execution strategy
  • Influence key stakeholders across the company, advocating for resources and driving platform adoption

Requirements For Principal Engineer, Platform and Scale, Vertex AI

Python
  • Bachelor's degree in Computer Science, similar technical field of study, or equivalent practical experience
  • 15 years of experience in software engineering leadership roles and building developer-facing products or platforms
  • Experience with generative AI (LLMs, diffusion models, etc.), development workflows, and use cases
  • Experience in technical leadership, leading global projects and setting technical direction for teams
  • Experience driving engineering excellence through testing, monitoring, and continuous improvement
  • Strong understanding of Agile methodologies and software development lifecycle
  • Understanding of developer needs, with the ability to translate them into exceptional software tools and experiences
  • Proven and dynamic leader with the ability to set a vision and inspire those around them

Benefits For Principal Engineer, Platform and Scale, Vertex AI

Medical Insurance
Parental Leave
  • Equal opportunity employer
  • Accommodation for special needs
  • Comprehensive benefits (implied from being Google)

Interested in this job?

Jobs Related To Google Principal Engineer, Platform and Scale, Vertex AI

Product Manager, TPU

Lead product strategy and development for Google's TPU Machine Learning infrastructure, driving innovation in ML capabilities and hardware solutions.

Senior Product Manager, Assistant Natural Language Processing

Lead product development for Google Assistant's NLP team, focusing on LLM implementation and AI solutions for home applications.

Silicon AI/ML Lead Architect

Lead the development of next-generation AI accelerator architectures for Google Cloud's data centers, focusing on custom silicon solutions and hardware/software optimization.

Principal, Specialized Software, AI, Office of the CTO

Principal Engineer role at Google Cloud's OCTO, focusing on AI innovation and strategic customer transformation with 15+ years of technical leadership experience required.

Silicon AI/ML Architect, TPU, Google Cloud

Lead the architecture development of AI/ML SoCs for Google Cloud's TPU platform, focusing on performance optimization and hardware-software integration.