Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex
Description For Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex
Google's ML, Systems and Cloud AI (MSCA) organization is seeking a Distinguished Engineer to lead GPU optimization and infrastructure development. This role combines deep technical expertise in GPU architecture and ML systems with strategic leadership responsibilities. The position involves working with Core ML, Google's central machine learning platform team, to drive ML excellence across Google's product portfolio including Search, Ads, Youtube, Cloud, and Maps.
The role requires extensive experience (18+ years) in GPU performance optimization and large-scale infrastructure systems. The successful candidate will evaluate upcoming hardware technologies, optimize ML models for performance, and work closely with both cloud and internal customers. They will play a crucial role in bridging TPU and GPU technologies while creating robust infrastructure for ML systems access.
This is a unique opportunity to impact Google's ML infrastructure at scale, working with cutting-edge technologies including Gemini models. The position offers competitive compensation ($349,000-$485,000 base salary) plus bonus, equity, and comprehensive benefits. The ideal candidate will combine technical depth in GPU architectures and ML optimization with strong leadership and communication skills.
The role is based in Sunnyvale, CA, and offers the chance to work with Google Cloud, which serves customers in over 200 countries. This position is perfect for someone passionate about advancing ML technology while solving critical business challenges at a global scale.
Responsibilities For Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex
- Lead efforts to optimize machine learning models for speed, memory efficiency, and accuracy
- Translate customer requirements into technical solutions
- Guide and inspire junior engineers by leading by example
- Identify bottlenecks and areas for improvement
- Influence architecture of Google's internal and external software architecture
Requirements For Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex
- Bachelor's degree in Computer Science, a similar field, or equivalent practical experience
- 18 years of experience working with GPU inference optimization
- 18 years of experience in GPU performance related work
- Experience designing and developing large-scale infrastructure systems
- GPU Inference optimization experience
- Deep understanding of modern GPU architectures memory hierarchies, and performance bottlenecks
- Ability to develop and utilize sophisticated performance models and benchmarks
- Excellent communication and people skills
- Expertise in tailoring algorithms and ML models to exploit GPU strengths
Benefits For Distinguished Engineer, GPUs, Core ML, Borg, Spatial Flex
- bonus
- equity
- benefits
