Taro Logo

AIML - Engineering Manager, ML Systems Evaluation Engineering

A leading technology company that creates groundbreaking products and services in computing, mobile devices, and artificial intelligence.
$219,300 - $329,600
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For AIML - Engineering Manager, ML Systems Evaluation Engineering

Apple's Global Evaluation Engineering team within the AIML organization is seeking an Engineering Manager to lead the evaluation of machine learning systems globally. This role focuses on driving the evaluation of large-scale, end-to-end ML systems, particularly for Siri and Apple Intelligence products deployed across 40 languages and multiple Apple platforms.

The position offers an opportunity to work at the forefront of AI technology, directly impacting products used by millions of people worldwide. As an Engineering Manager, you'll collaborate with multiple engineering teams to design and execute evaluation strategies for Apple Intelligence. The role involves crafting success metrics, defining program scope/vision, and ensuring successful production delivery.

The ideal candidate will bring strong leadership experience in ML-powered systems, with a focus on evaluation and testing. You'll work in a fast-paced, innovative environment that values collaboration and technical excellence. The position offers competitive compensation, including a base salary range of $219,300 to $329,600, plus additional benefits such as stock options and comprehensive healthcare.

This role is perfect for someone who excels in cross-functional leadership, has deep technical knowledge of ML systems, and can drive complex projects to completion. You'll be responsible for optimizing Siri evaluation processes, coordinating quality metrics, and ensuring high standards across Apple's AI initiatives. The position offers significant growth opportunities and the chance to work on cutting-edge technology that shapes the future of artificial intelligence at Apple.

Working at Apple's Cupertino location, you'll be at the heart of innovation, collaborating with world-class teams to advance the boundaries of AI technology. The role combines technical leadership with strategic thinking, requiring someone who can balance multiple priorities while maintaining focus on delivering exceptional user experiences through robust ML evaluation systems.

Last updated 6 months ago

Responsibilities For AIML - Engineering Manager, ML Systems Evaluation Engineering

  • Partner with cross-functional teams to define datasets, metrics, quality plans, and evaluation methodologies
  • Coordinate the execution, tracking, and reporting of quality metrics for Siri and ML-powered systems
  • Be the liaison among Product, Engineering, and Eval organizations
  • Optimize and coordinate Siri evaluation and ensure issues are addressed promptly before product release
  • Participate in the creation of new evaluation datasets and strategies for Apple Intelligence

Requirements For AIML - Engineering Manager, ML Systems Evaluation Engineering

  • 5+ years engineering management experience working with E2E systems, preferably ML-powered
  • Experience managing projects spanning multiple cross-functional teams
  • Experience with testing and evaluating complex Machine Learning products
  • Experience with ML development lifecycle, including ML algorithm development and accuracy hillclimbing
  • M.S. in Computer Science or equivalent (preferred)
  • Outstanding communication and presentation abilities
  • Self-motivated and proactive, with multi-tasking capabilities

Benefits For AIML - Engineering Manager, ML Systems Evaluation Engineering

Medical Insurance
Dental Insurance
401k
Equity
Education Budget
Relocation Benefits
  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Employee stock programs
  • Education reimbursement
  • Discretionary restricted stock unit awards
  • Employee Stock Purchase Plan
  • Discretionary bonuses
  • Relocation benefits
  • Product discounts
  • Free services

Interested in this job?