Taro Logo

Staff Software Engineer, Core Machine Learning, TPU, GPU

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
$197,000 - $291,000
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Staff Software Engineer, Core Machine Learning, TPU, GPU

Google is seeking a Staff Software Engineer to join their Core Machine Learning team, focusing on TPU and GPU technologies. This role is at the forefront of machine learning inference, working to provide industry-leading solutions on both Tensor Processing Unit (TPU) and Graphics Processing Unit (GPU) platforms. The position involves creating seamless, efficient, and cost-effective inference experiences for users while building and optimizing third-party inference stacks.

The role requires deep expertise in machine learning frameworks, inference optimization, and cloud platforms. You'll be working with cutting-edge technology, contributing to open-source projects like virtual large language models (vLLM), and implementing TPU-specific backends. The position offers the opportunity to work on Google Cloud Platform's infrastructure and collaborate with cross-functional teams.

As a technical leader, you'll be responsible for managing project priorities, deadlines, and deliverables while contributing to technical roadmaps. The role combines hands-on development with strategic planning and team leadership. You'll be working in a dynamic environment where you can influence the future of machine learning infrastructure at Google.

The position offers competitive compensation including a base salary range of $197,000-$291,000, plus bonus, equity, and comprehensive benefits. This is an excellent opportunity for someone who wants to work at the intersection of machine learning, high-performance computing, and cloud infrastructure while making a significant impact on Google's machine learning capabilities.

Last updated 4 days ago

Responsibilities For Staff Software Engineer, Core Machine Learning, TPU, GPU

  • Provide technical leadership on projects
  • Manage project priorities, deadlines and deliverables
  • Develop and optimize ML inference solutions for TPUs and GPUs
  • Contribute to internal and GCP-specific repositories
  • Collaborate with cross-functional teams
  • Participate in community engagement and governance for open-source repositories

Requirements For Staff Software Engineer, Core Machine Learning, TPU, GPU

Python
  • Bachelor's degree or equivalent practical experience
  • 8 years of experience in software development
  • 5 years of experience testing and launching software products
  • 3 years of experience with software design and architecture
  • 5 years of experience with machine learning frameworks (e.g., PyTorch, JAX)
  • 3 years of experience with ML inference concepts and optimization techniques
  • Experience with cloud platforms and open-source development

Benefits For Staff Software Engineer, Core Machine Learning, TPU, GPU

Medical Insurance
401k
  • Bonus
  • Equity
  • Benefits package

Interested in this job?

Jobs Related To Google Staff Software Engineer, Core Machine Learning, TPU, GPU