Senior Machine Learning Engineer, ML Systems Evaluation Engineering

Apple is where individual imaginations gather together, creating groundbreaking products and services that change lives for the better.
$175,800 - $312,200
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
7+ years of experience
AI

Description For Senior Machine Learning Engineer, ML Systems Evaluation Engineering

Apple is seeking a highly skilled Senior Machine Learning Engineer specializing in Conversational AI to join their dynamic team within Apple Intelligence and Siri. This role is at the forefront of the next revolution in machine learning and Generative AI, focused on creating groundbreaking conversational assistant technologies.

The position involves working with the ML Systems Evaluation Engineering (MLSEE) team to evaluate AI/ML products that impact millions of users worldwide. The successful candidate will play a crucial role in delivering offline evaluation insights that drive model development and improvements, while maintaining Apple's high privacy standards.

Key responsibilities include leading the creation and evolution of high-quality datasets for evaluating state-of-the-art models, leveraging large language models (LLMs) for automatic evaluation of model changes, and assessing conversation quality with digital assistants. The role also involves creating adversarial scenarios to anticipate future user behaviors and edge cases.

The ideal candidate should have 7+ years of professional experience in machine learning, an MS/PhD in Computer Science or related field, and strong Python programming skills. They should possess excellent problem-solving abilities and deep knowledge of Conversational AI.

This position offers a competitive salary range of $175,800 to $312,200, along with comprehensive benefits including medical, dental, and vision insurance, stock options, 401k, and education reimbursement. Join Apple in shaping the future of AI and machine learning while working on products that impact millions of users globally.

Working at Apple means joining a team where individual imaginations come together to create groundbreaking technologies that change lives for the better. The role offers the opportunity to contribute to the evolution of Siri and other AIML products, making technology more accessible and helpful to users worldwide.

Last updated 7 days ago

Responsibilities For Senior Machine Learning Engineer, ML Systems Evaluation Engineering

  • Lead creation and evolution of high quality datasets for evaluation of state-of-the-art models
  • Leverage large language models to automatically evaluate model changes impact
  • Assess quality and naturalness of conversations with digital assistant
  • Create adversarial scenarios to anticipate future user behaviors and edge cases
  • Develop offline evaluation insights that drive model improvements

Requirements For Senior Machine Learning Engineer, ML Systems Evaluation Engineering

Python
  • 7+ years of professional work experience applying machine learning to real-world problems
  • Experience with managing datasets for ML training and/or evaluation
  • MS/PhD in Machine Learning, Computer Science, or equivalent experience
  • Excellent programming skills in Python

Benefits For Senior Machine Learning Engineer, ML Systems Evaluation Engineering

Medical Insurance
Dental Insurance
Vision Insurance
401k
Education Budget
Equity
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • 401k
  • Education Budget
  • Equity

Interested in this job?

Jobs Related To Apple Senior Machine Learning Engineer, ML Systems Evaluation Engineering

AIML - Machine Learning Engineer, Machine Learning Platform & Infrastructure

Senior Machine Learning Engineer role at Apple, focusing on ML infrastructure and platform development for large-scale AI systems and foundation models.

AIML - Staff Machine Learning Engineer(Search and Knowledge Quality), Siri and Information Intelligence

Staff Machine Learning Engineer role at Apple working on Siri and Information Intelligence, focusing on search and knowledge quality, requiring 15+ years of experience in ML/AI.

Applied Machine Learning Research Engineer, Siri

Senior Applied ML Research Engineer position at Apple focusing on generative AI and LLMs for Siri, offering competitive compensation and benefits in Seattle.

Machine Learning Engineer, Natural Language Generation

Machine Learning Engineer role at Apple focusing on natural language generation and AI-driven text input features, offering competitive compensation and benefits.

AIML - Machine Learning Engineer, Siri and Information Intelligence

Machine Learning Engineer position at Apple focusing on LLMs and generative AI for Siri and Information Intelligence, offering competitive compensation and benefits.