Senior Software Engineer, Model Evaluation

Waymo is an autonomous driving technology company with the mission to be the most trusted driver. Since its start as the Google Self-Driving Car Project in 2009, Waymo has focused on building the Waymo Driver—The World's Most Experienced Driver™—to improve access to mobility while saving thousands of lives now lost to traffic crashes.

The ML Platform team at Waymo provides a set of tools to support and automate the lifecycle of the machine learning workflow, including feature and experiment management, model development, debugging, inference, deployment, and monitoring. These efforts have resulted in making machine learning more accessible to teams at Waymo, including Perception, Behavior Prediction, Planner, Routing, Maps and Research, ensuring greater degrees of consistency and repeatability, and addressing the "last mile" of getting models into production and managing them once they are in place.

Machine learning model evaluation is important to understand model performance. It guides model owners to choose the right strategy to improve their model, and choose the right one for launch. You will report to the TLM with focus on developing large-scale and efficient model evaluation infrastructure and solutions for Waymo.

At a minimum, we'd like you to have:

• B.S. in Computer Science, Math, or equivalent real-world experience
• 5+ years of experience with software development in one or more programming languages (C++ or Python preferred), and with data structures/algorithms.
• 3 years of experience developing large-scale infrastructure or distributed systems.
• 3 years of experience testing, maintaining, or launching software products, and 1 year of experience with software design and architecture.
• Understanding of machine learning fundamentals and experience with popular ML frameworks such as JAX, PyTorch, or TensorFlow
• Experience building scalable data platforms for real-time and batch processing
• ML accelerator profiling, resources and latency optimization, and designing production-grade systems

It's preferred if you have:

• MS in Computer Science, Math, or equivalent real-world experience
• Prior experience scaling model evaluation to multiple accelerators
• Prior experience high-scale distributed or ML systems
• Previous experience deploying machine learning models for computer vision, natural language processing, or recommendation systems

The expected base salary range for this full-time position across US locations is $192,000—$243,000 USD. Actual starting pay will be based on job-related factors, including exact work location, experience, relevant training and education, and skill level. Waymo employees are also eligible to participate in Waymo's discretionary annual bonus program, equity incentive plan, and generous Company benefits program, subject to eligibility requirements.