Software Engineer, ML/AI Reference Models, Google Cloud

Google is a global technology leader that specializes in internet-related services and products, including search, cloud computing, software, and hardware.
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer, ML/AI Reference Models, Google Cloud

Google Cloud is seeking a Software Engineer specializing in ML/AI Reference Models to join their Technical Infrastructure team. This role focuses on shaping the future of AI/ML hardware acceleration, particularly working with TPU (Tensor Processing Unit) technology that powers Google's most demanding AI/ML applications. The position involves developing functional and performance models for ML compute IPs and integrating them with the Cloud TPU SoC model.

As part of a diverse team, you'll be pushing boundaries in custom silicon solutions that power Google's TPU. Your responsibilities will include working closely with ML and SoC architecture teams to understand instruction sets and architecture of ML IPs in detail. You'll collaborate with pre-silicon, post-silicon, and software teams to implement these models in their validation flows, contributing to the delivery of high-quality designs for next-generation data center accelerators.

The role is based in Google's Technical Infrastructure team, which is fundamental to maintaining and developing Google's data centers and platforms. This team takes pride in being the engineers' engineers, focusing on keeping networks running optimally and ensuring the best possible user experience.

This position offers an exciting opportunity to work at the intersection of hardware and machine learning, contributing to cutting-edge technology that powers Google's AI applications. The ideal candidate will combine technical expertise in hardware modeling with a strong understanding of machine learning architectures, making this role perfect for someone passionate about advancing AI hardware acceleration technology.

Working at Google also means being part of a company that values diversity, equality, and inclusion, with a strong commitment to building a representative workforce and creating a culture of belonging. The role offers the chance to work on impactful projects while being part of a supportive and innovative team environment.

Last updated 3 days ago

Responsibilities For Software Engineer, ML/AI Reference Models, Google Cloud

  • Study the instruction set and architecture of the ML IPs and drive discussions on the delta features from the previous generation
  • Develop functional and/or performance models for the ML IPs. Integrate the functional models with the Cloud TPU SoC model and deliver the single source of truth architectural reference
  • Work with pre-silicon verification and post-silicon validation teams to deploy the models into their validation flows
  • Work with compiler and software teams to enable them to left-shift their development activity

Requirements For Software Engineer, ML/AI Reference Models, Google Cloud

Python
  • Bachelor's degree in Computer Science, a related technical field, or equivalent practical experience
  • 2 years of experience with developing simulators or reference models for hardware
  • Experience with programming in C/C++ and scripting (e.g., Python/Perl)
  • Master's degree in Computer Science, Electrical Engineering, or a related field (preferred)
  • Experience in modeling Machine Learning IPs, specifically compute IPs (preferred)
  • Experience in integrating IP models with the SoC model (preferred)
  • Familiarity with industry standard AI/ML topologies such as RESNET, BERT, etc. (preferred)

Interested in this job?

Jobs Related To Google Software Engineer, ML/AI Reference Models, Google Cloud

Software Engineer III, Machine Learning, Google Research

Software Engineer III position at Google Research focusing on machine learning and AI development, combining research innovation with practical product implementation.

Software Engineer III, AI/ML GenAI, Google Cloud

Software Engineer III position at Google Cloud focusing on AI/ML and GenAI development, offering competitive salary and benefits.

Software Engineer III, AI/ML, Google Cloud AI

Software Engineer III position at Google Cloud AI, focusing on machine learning infrastructure and implementation with competitive compensation and benefits.

Software Developer III, Machine Learning, Google Research

Join Google Research as a Software Developer III in Machine Learning, developing intelligent systems and next-generation technologies that impact billions of users worldwide.

Software Engineer III, Machine Learning, Google Research

Software Engineer III position at Google Research, focusing on machine learning and AI development, requiring 2+ years of experience in software development and ML algorithms.