Taro Logo

Software Engineer III, AI/ML, Cloud AI Infrastructure

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS · Cloud

Description For Software Engineer III, AI/ML, Cloud AI Infrastructure

Google is seeking a Software Engineer III to join their ML, Systems, & Cloud AI (MSCA) organization, focusing on AI/ML infrastructure. This role is crucial for developing and optimizing machine learning systems that power Google's services and Google Cloud. The position involves working with cutting-edge AI technologies, including Generative AI and Large Language Models, while ensuring performance, reliability, and efficiency at scale.

The ideal candidate will have strong software development experience combined with expertise in machine learning infrastructure and distributed computing. They will be responsible for measuring and optimizing AI/ML model performance, resolving bottlenecks, and contributing to product improvements through code development and testing.

This role offers the opportunity to work on technology that impacts billions of users worldwide, particularly through Google Cloud's Vertex AI platform and enterprise-level AI solutions. The position requires collaboration with cross-functional teams and the ability to adapt in a fast-paced environment where AI technologies are continuously evolving.

Working at Google's Taipei office, you'll be part of a global team that designs, implements, and manages the infrastructure powering all Google services and Cloud offerings. The role combines technical depth in AI/ML with practical software engineering, making it ideal for someone passionate about both fields and interested in working at the forefront of AI technology development.

Last updated 2 days ago

Responsibilities For Software Engineer III, AI/ML, Cloud AI Infrastructure

  • Measure and optimize AI/ML model performance on Google Cloud infrastructure
  • Identify and resolve performance bottlenecks
  • Develop and deliver high-quality training and demos
  • Contribute to ongoing product improvement
  • Conduct in-depth performance profiling, debugging, and troubleshooting

Requirements For Software Engineer III, AI/ML, Cloud AI Infrastructure

Python
Kubernetes
  • Bachelor's degree or equivalent practical experience
  • 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree
  • 2 years of experience with data structures or algorithms
  • Master's degree or PhD in Computer Science or related technical field (preferred)
  • Experience with Generative AI, Large Language Models (LLM), or Machine Learning infrastructure (preferred)
  • Experience with distributed computing leveraging GPUs or TPUs (preferred)
  • Experience with cloud services in Compute, Storage, or Networking (preferred)

Benefits For Software Engineer III, AI/ML, Cloud AI Infrastructure

Medical Insurance
Visa Sponsorship
  • Equal opportunity employer
  • Accommodation for special needs
  • Parental support

Interested in this job?

Jobs Related To Google Software Engineer III, AI/ML, Cloud AI Infrastructure