Taro Logo

Senior Software Engineer, ML Deployment Optimization

Google organizes the world's information and makes it universally accessible and useful, combining AI, Software, and Hardware to create helpful experiences.
New Taipei, Banqiao District, New Taipei City, TaiwanZhubei, Zhubei City, Hsinchu County, Taiwan 302
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI

Description For Senior Software Engineer, ML Deployment Optimization

Google is seeking a Senior Software Engineer to join their Tensor ML Deployment Optimization team, focusing on mobile ML performance for Pixel devices. This role combines cutting-edge machine learning, systems engineering, and hardware optimization to enhance Google's custom Tensor SoC platform.

The position requires deep expertise in both software development and machine learning deployment, with a focus on optimizing performance for mobile and edge devices. You'll work at the intersection of ML frameworks, compilers, and hardware acceleration, leading critical projects that impact Google's strategic partnerships and product performance.

As a technical leader, you'll not only solve complex optimization challenges but also mentor junior engineers and shape best practices for ML deployment. The role offers the opportunity to influence future hardware/software designs and work directly with external partners to improve the broader ML ecosystem.

The ideal candidate brings strong software engineering fundamentals (particularly in C++ and Python), demonstrated experience in ML deployment or systems optimization, and excellent leadership and communication skills. This position offers the chance to work on Google's cutting-edge AI hardware while contributing to the company's mission of organizing the world's information and making it universally accessible.

Working at Google provides exposure to world-class engineering challenges, collaboration with talented peers, and the opportunity to impact billions of users through your work on Pixel devices and the Tensor platform. The role combines technical depth with strategic impact, making it an excellent opportunity for senior engineers passionate about ML optimization and system performance.

Last updated 2 days ago

Responsibilities For Senior Software Engineer, ML Deployment Optimization

  • Lead the deployment and performance optimization of critical ML models from strategic third-party developers on Google Tensor SoCs
  • Design and implement full-stack optimization strategies, and drive technical analysis and resolution of performance/deployment issues
  • Architect, design, and develop reusable tools, libraries, and infrastructure to accelerate ML deployment
  • Provide technical leadership and mentorship to junior engineers
  • Collaborate with external partners and internal teams to improve the ML ecosystem

Requirements For Senior Software Engineer, ML Deployment Optimization

Python
  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience
  • 5 years of experience with software development in C++ and Python
  • Experience in technical leadership, leading project teams, and setting technical direction
  • Experience in machine learning deployment, ML frameworks/compilers, performance analysis, computer architecture, embedded systems development, or accelerator programming

Interested in this job?

Jobs Related To Google Senior Software Engineer, ML Deployment Optimization