Taro Logo

Senior Software Engineer, Cloud AI/Machine Learning Infrastructure

Google Cloud accelerates organizations' digital transformation by delivering enterprise-grade solutions leveraging cutting-edge technology and developer tools.
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS · Cloud

Description For Senior Software Engineer, Cloud AI/Machine Learning Infrastructure

Google Cloud is seeking a Senior Software Engineer to join their Cloud ML Compute Services team, focusing on advancing AI infrastructure capabilities. This role combines deep technical expertise in machine learning infrastructure with cloud computing, requiring skills in performance optimization and distributed systems. The position involves working with cutting-edge AI technologies, including Large Language Models and GPU/TPU computing environments.

As a key member of the team, you'll be responsible for optimizing ML workload performance across the entire technical stack, from networking and storage to model deployment. You'll work on designing and implementing custom ML solutions, taking them from prototype to production while ensuring optimal performance and scalability.

The role offers the opportunity to work with Google's cutting-edge technology stack and contribute to solutions that help organizations across 200+ countries transform their businesses. You'll collaborate with cross-functional teams globally, troubleshoot complex technical challenges, and drive innovation in AI infrastructure.

The ideal candidate should have strong software engineering fundamentals, experience with AI/ML infrastructure, and the ability to thrive in a dynamic environment where AI technologies are rapidly evolving. This position offers the chance to make a significant impact on Google Cloud's AI capabilities while working with some of the most advanced technology in the field.

Benefits include working with cutting-edge AI technology, collaborating with world-class engineers, and the opportunity to shape the future of cloud AI infrastructure. The role is based in Taipei, Taiwan, offering the chance to work in one of Asia's leading tech hubs while contributing to global projects.

Last updated 6 days ago

Responsibilities For Senior Software Engineer, Cloud AI/Machine Learning Infrastructure

  • Measure and enhance performance on Google Cloud across the technical stack, including storage, networking, and model throughput
  • Conduct performance profiling, debugging, and troubleshooting of AI/ML training and inference workloads
  • Partner with cross-functional, cross-regional teams to ensure the AI/ML infrastructure delivers excellent value
  • Identify and resolve performance bottlenecks, ensuring the infrastructure operates at optimal levels
  • Support the future of the AI/ML infrastructure by identifying gaps in the existing products and recommending enhancements

Requirements For Senior Software Engineer, Cloud AI/Machine Learning Infrastructure

Python
Java
Go
  • Bachelor's degree in Computer Science or equivalent practical experience
  • 5 years of experience with software development in one or more programming languages, and with data structures/algorithms
  • 3 years of experience with full stack development, across back-end such as Python, Java, C++, or GO codebases
  • 3 years of experience testing, maintaining, or launching software products
  • 1 year of experience with software design and architecture

Interested in this job?

Jobs Related To Google Senior Software Engineer, Cloud AI/Machine Learning Infrastructure