Director, Engineering, ML Compiler

Google is a leading ML/AI company building state-of-the-art AI platforms, services, and tools for research and AI-powered products.
$294,000 - $414,000
Machine Learning
Principal Software Engineer
In-Person
5,000+ Employees
15+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:
Silicon AI/ML Architect, TPU, Google Cloud

Lead the architecture of AI/ML SoCs for Google Cloud's TPU team, developing next-generation hardware solutions for machine learning acceleration.

Silicon AI/ML Architect, TPU, Google Cloud

Lead the architecture development of AI/ML SoCs for Google Cloud's TPU team, focusing on performance optimization and next-generation AI accelerator design.

Principal Machine Learning Engineer, AI Architecture - Ad Platforms

Principal Machine Learning Engineer role at Disney focused on architecting and implementing advanced AI solutions for the company's advertising platforms.

Principal Data Scientist - Oracle Labs

Principal Data Scientist position at Oracle Labs in Zurich, focusing on cutting-edge AI, LLMs, and AI Agents for enterprise applications. 10+ years experience required.

Machine Learning Compiler Architect

Senior compiler architecture role focused on developing and optimizing machine learning compilers for Apple's Neural Engine hardware accelerator.

Description For Director, Engineering, ML Compiler

Google's Core ML team is seeking a Director of Engineering for their ML Compiler division, offering an exceptional opportunity to shape the future of machine learning infrastructure. This role combines leadership in compiler development with machine learning expertise, requiring 15 years of industry experience and 10 years of team leadership. The position involves directing the development of cutting-edge ML compilers for Google's custom hardware architectures, including TPUs and GPUs.

The role sits at the intersection of research, product development, and hardware engineering, making it crucial for Google's AI infrastructure. The successful candidate will lead compiler optimization efforts that directly impact Google's AI frameworks like TensorFlow and JAX, while working on large-scale models such as Gemini. They will be responsible for building and mentoring a team of skilled compiler engineers, establishing technical direction, and fostering partnerships across different departments.

The compensation package is highly competitive, ranging from $294,000 to $414,000 base salary, plus bonus, equity, and comprehensive benefits. This position is based in Sunnyvale, CA, offering the opportunity to work with world-class engineers and researchers in Google's Core ML team. The role requires exceptional technical expertise in compiler development, machine learning optimization, and hardware acceleration, combined with strong leadership and communication skills.

The impact of this position extends beyond just compiler development – it's about shaping Google's hardware strategy and optimizing the performance of AI systems across the company. The director will play a crucial role in maximizing ROI for Google's AI investments and enabling all Google products to adopt Large Models effectively. This is an opportunity to influence important technical decisions across one of the world's leading technology companies while working on cutting-edge AI infrastructure.

Last updated a month ago

Responsibilities For Director, Engineering, ML Compiler

  • Define the long-term strategic vision for our ML compiler technology and roadmap. Establish technical direction, goals, and development priorities
  • Recruit, mentor, and develop a highly skilled team of compiler engineers focused on machine learning optimization. Create a collaborative and high-achieving work environment
  • Forge strong partnerships with research, product, hardware, and core ML teams. Drive alignment and effective collaboration to ensure optimal compiler solutions for Google's custom TPU and GPU strategies
  • Apply your deep expertise in compilers and machine learning to optimize system performance, reduce software overheads, and seamlessly support new hardware. Advocate innovation and the application of new technologies
  • Cultivate a deep understanding of customer needs, driving a relentless focus on enabling their success through compiler capabilities

Requirements For Director, Engineering, ML Compiler

Python
  • Master's degree in Computer Science, Computer Engineering, a related field, or equivalent practical experience
  • 15 years of industry experience in compiler development, including machine learning optimization
  • 10 years of experience leading and growing technical teams
  • Experience with ML accelerators like TPUs or GPUs
  • Experience in computer architecture, high-performance computing
  • Experience building compilers for custom hardware architectures
  • In-depth knowledge of machine learning frameworks (e.g., Jax, PyTorch, TensorFlow)
  • Outstanding communication skills tailored to both technical and non-technical audiences
  • Contributions to open-source compiler projects

Benefits For Director, Engineering, ML Compiler

Medical Insurance
Dental Insurance
Vision Insurance
Parental Leave
  • bonus
  • equity
  • benefits

Interested in this job?