Taro Logo

Software Engineer III, AI/ML, Cloud AI Infrastructure

Google develops next-generation technologies that change how billions of users connect, explore, and interact with information and one another.
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS · Cloud

Description For Software Engineer III, AI/ML, Cloud AI Infrastructure

Google is seeking a Software Engineer III to join their ML, Systems, & Cloud AI (MSCA) organization, focusing on AI/ML infrastructure development and optimization. This role is critical in shaping the future of hyperscale computing and enterprise AI solutions.

The position involves working with cutting-edge technologies including Google Cloud's Vertex AI platform and Gemini models. You'll be responsible for measuring and optimizing AI/ML model performance on Google Cloud infrastructure, identifying and resolving performance bottlenecks, and ensuring the efficient operation of demanding AI workloads.

As part of Google's engineering team, you'll have the opportunity to work on technologies that impact billions of users worldwide. The role requires expertise in distributed computing, particularly with GPUs or TPUs, and a strong understanding of cloud services in Compute, Storage, and Networking.

The ideal candidate should have at least 2 years of experience with software development and data structures/algorithms. A background in Generative AI, Large Language Models (LLM), or Machine Learning infrastructure is highly valued. You'll be working in a dynamic, fast-paced environment where AI technologies are continuously advancing.

Google offers a collaborative environment where you'll work with cross-functional teams to develop and improve products that handle information at massive scale. The company provides comprehensive benefits and is committed to creating an inclusive workplace that values diversity and equal opportunity.

This role is based in Taipei, Taiwan, and offers the chance to work on critical projects that shape the future of AI infrastructure. You'll be part of an organization that prioritizes security, efficiency, and reliability across all operations, from TPU development to global network management.

Join Google's team to contribute to groundbreaking AI technologies, work with enterprise customers, and help shape the future of cloud computing and artificial intelligence. This position offers excellent growth opportunities and the chance to work with some of the most advanced AI infrastructure in the industry.

Last updated 2 days ago

Responsibilities For Software Engineer III, AI/ML, Cloud AI Infrastructure

  • Measure and optimize AI/ML model performance on Google Cloud infrastructure
  • Identify and resolve performance bottlenecks
  • Develop and deliver high-quality training and demos
  • Contribute to ongoing product improvement
  • Conduct in-depth performance profiling, debugging, and troubleshooting

Requirements For Software Engineer III, AI/ML, Cloud AI Infrastructure

Python
  • Bachelor's degree or equivalent practical experience
  • 2 years of experience with software development in one or more programming languages, or 1 year of experience with an advanced degree
  • 2 years of experience with data structures or algorithms
  • Master's degree or PhD in Computer Science or related technical field (preferred)
  • Experience with Generative AI, Large Language Models (LLM), or Machine Learning infrastructure (preferred)
  • Experience with distributed computing leveraging GPUs or TPUs (preferred)
  • Experience with cloud services in Compute, Storage, or Networking (preferred)

Benefits For Software Engineer III, AI/ML, Cloud AI Infrastructure

Medical Insurance
Vision Insurance
Dental Insurance
Parental Leave
  • Equal opportunity employer
  • Accommodations for applicants with disabilities

Interested in this job?

Jobs Related To Google Software Engineer III, AI/ML, Cloud AI Infrastructure