Taro Logo

Software Engineer III, ML Compiler, Infrastructure

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
2+ years of experience
AI

Job Description

Google is seeking a Software Engineer III to join their ML Compiler Infrastructure team. This role focuses on device code generation for GPU, specifically generating efficient instructions to execute ML models and maintaining infrastructure for compiler engineers. The position involves working with cutting-edge technologies in machine learning compilation, particularly for GPU optimization.

The ideal candidate will have strong C++ programming skills and experience with large-scale infrastructure or distributed systems. Knowledge of GPU optimization and compiler fundamentals is highly valued. The role offers opportunities to work on critical projects that enable high-performance inference and training of ML models across Alphabet's ecosystem.

As part of Google Cloud, you'll be contributing to solutions that help organizations digitally transform their businesses. The team's work directly impacts the performance of both first-party and third-party ML models on GPU platforms. This is a chance to work with advanced technologies while collaborating with talented engineers on challenging technical problems.

The position offers exposure to various aspects of ML infrastructure, from low-level GPU optimization to high-level compiler architecture. You'll be responsible for maintaining and improving critical infrastructure that supports Google's ML capabilities, working with modern tools and technologies in a fast-paced, innovative environment.

This role presents an excellent opportunity for engineers interested in the intersection of machine learning, compiler technology, and high-performance computing. You'll be part of a team that's pushing the boundaries of ML compiler infrastructure while working on solutions that impact billions of users worldwide.

Last updated 14 days ago

Responsibilities For Software Engineer III, ML Compiler, Infrastructure

  • Improve the code quality, architecture and testability of the codebase
  • Work towards a better separation of runtime and compile time functionality in XLA:GPU
  • Integrate external libraries such as NVIDIA's cuDNN in google3 and XLA, and keep them up to date
  • Maintain and extend infrastructure and tools to improve the compiler's reliability and team velocity

Requirements For Software Engineer III, ML Compiler, Infrastructure

  • Bachelor's degree or equivalent practical experience
  • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting
  • 2 years of experience with developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture
  • 2 years of software development experience in C++

Related Jobs

Software Engineer II, AI-Powered Developer Experience

Software Engineer II position at Google focusing on AI-Powered Developer Experience, building next-generation technologies and infrastructure in Munich, Germany.

Software Engineer III, ML Compiler, Infrastructure

Software Engineer III position at Google focusing on ML compiler infrastructure and GPU optimization, requiring C++ expertise and distributed systems experience.

Software Engineer II, AI-Powered Developer Experience

Software Engineer II position at Google focusing on AI-Powered Developer Experience, building technical foundations and developer platforms in Munich, Germany.

Data Scientist in Cloud & Machine Learning (m/f/d)

Data Scientist position focusing on cloud and machine learning implementation in healthcare, developing AI solutions for care planning and optimization at ResMed's MEDIFOX DAN.

AI Developer for Medical Controlling solutions

AI Developer position at CGM, focusing on developing AI solutions for medical controlling systems using C# .NET, combining healthcare technology with artificial intelligence.