Taro Logo

Staff Software Engineer, ML Compilers

Google's mission is to organize the world's information and make it universally accessible and useful.
New Taipei, Banqiao District, New Taipei City, Taiwan
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For Staff Software Engineer, ML Compilers

Google is seeking a Staff Software Engineer to join their ML Compilers team, focusing on the development and optimization of EdgeTPU compiler systems. This role combines advanced compiler technology with machine learning, requiring expertise in both software engineering and ML systems. The position involves working with cutting-edge AI accelerator technology, optimizing ML workloads, and collaborating with hardware architects to design next-generation systems.

The ideal candidate will have extensive experience in software development, particularly in compiler systems and ML model optimization. They will work on critical projects involving parallelization algorithms, hardware-software interface design, and the efficient mapping of generative AI models to EdgeTPU instructions.

This role offers the opportunity to work at the intersection of compiler technology and machine learning, directly impacting Google's AI hardware capabilities. The position requires collaboration across multiple teams, including hardware architects, ML researchers, and product managers, to drive innovation in AI acceleration technology.

Working at Google, you'll be part of a team that's pushing the boundaries of AI hardware and software integration, with access to world-class resources and the opportunity to impact billions of users. The role combines technical leadership with hands-on development, requiring both deep technical expertise and strong collaborative skills.

Last updated a month ago

Responsibilities For Staff Software Engineer, ML Compilers

  • Work as part of the EdgeTPU compiler team, including analyzing and improving the compiler quality and performance on optimization decisions, correctness and compilation time
  • Develop parallelization and scheduling algorithms to optimize compute and data movement costs to execute ML workloads on the EdgeTPU
  • Work with EdgeTPU architects to design future accelerators, the hardware/software interface, and co-optimizations of the next generation EdgeTPU architectures
  • Work on efficient mapping of generative AI models and other key workloads into EdgeTPU instructions through the compiler
  • Work with Product Managers, Researchers in identifying key ML trends, future use cases, etc. Closely collaborate with ML model developers, researchers, and EdgeTPU hardware/software teams to accelerate the transition from research ideas to user experiences running on the EdgeTPU

Requirements For Staff Software Engineer, ML Compilers

  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development
  • 5 years of experience testing, and launching software products
  • 3 years of experience with software design and architecture
  • Experience with compilers (parallelization, etc.) or ML model development and C++ programming language

Interested in this job?