Taro Logo

Software Engineer III, ML Compiler, Infrastructure

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
2+ years of experience
AI

Job Description

Google is seeking a Software Engineer III to join their ML Compiler Infrastructure team. This role focuses on device code generation for GPU, specifically generating efficient instructions to execute ML models and maintaining infrastructure for compiler engineers. The position is critical for enabling high-performance inference and training of first- and third-party models on GPU across Alphabet.

The ideal candidate will have strong C++ programming skills and experience with large-scale infrastructure or distributed systems. Knowledge of GPU optimization and compiler fundamentals is highly valued. The role involves working with cutting-edge ML technologies and requires both technical depth in systems programming and the ability to collaborate effectively with compiler engineers and partners.

As part of Google Cloud, you'll be contributing to technology that helps organizations digitally transform their businesses. The team's work directly impacts Google's ability to serve billions of users efficiently through optimized ML model execution. This is an opportunity to work on fundamental infrastructure that powers Google's ML capabilities while being part of a team that pushes the boundaries of performance optimization.

The position offers exposure to complex technical challenges in ML infrastructure, compiler optimization, and GPU computing. You'll be working in an environment that values innovation and technical excellence, with opportunities to make significant contributions to Google's ML infrastructure. The role combines hands-on coding with architectural decision-making, making it ideal for engineers who enjoy both detailed technical work and broader system design.

Last updated 2 hours ago

Responsibilities For Software Engineer III, ML Compiler, Infrastructure

  • Improve the code quality, architecture and testability of the codebase
  • Work towards a better separation of runtime and compile time functionality in XLA:GPU
  • Integrate external libraries such as NVIDIA's cuDNN in google3 and XLA, and keep them up to date
  • Maintain and extend infrastructure and tools to improve the compiler's reliability and team velocity

Requirements For Software Engineer III, ML Compiler, Infrastructure

  • Bachelor's degree or equivalent practical experience
  • 2 years of experience with software development or 1 year of experience with an advanced degree in an industry setting
  • 2 years of experience with developing large-scale infrastructure, distributed systems or networks, or experience with compute technologies, storage or hardware architecture
  • 2 years of software development experience in C++

Benefits For Software Engineer III, ML Compiler, Infrastructure

Medical Insurance
Dental Insurance
Vision Insurance
401k
  • Comprehensive health benefits
  • Retirement plans
  • Equal employment opportunity

Related Jobs

Software Engineer II, AI-Powered Developer Experience

Software Engineer II position at Google focusing on AI-Powered Developer Experience, building next-generation technologies and infrastructure in Munich, Germany.

Software Engineer II, AI-Powered Developer Experience

Software Engineer II position at Google focusing on AI-Powered Developer Experience, building technical foundations and developer platforms in Munich, Germany.

Software Engineer III, ML Compiler, Infrastructure

Software Engineer III position at Google focusing on ML compiler infrastructure and GPU optimization, requiring C++ expertise and distributed systems experience.

Data Scientist in Cloud & Machine Learning (m/f/d)

Data Scientist position focusing on cloud and machine learning implementation in healthcare, developing AI solutions for care planning and optimization at ResMed's MEDIFOX DAN.

AI Developer for Medical Controlling solutions

AI Developer position at CGM, focusing on developing AI solutions for medical controlling systems using C# .NET, combining healthcare technology with artificial intelligence.