Taro Logo

AIML - Machine Learning Engineer, Model Evaluations

A leading technology company that designs, develops, and sells consumer electronics, software, and services.
$181,100 - $272,100
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
4+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For AIML - Machine Learning Engineer, Model Evaluations

Join Apple's Responsible AI group within the Human-Centered Machine Intelligence (HCMI) organization as a Model Evaluations Machine Learning Engineer. This role focuses on ensuring AI systems are safe, inclusive, and globally representative.

You will lead the evaluation strategies for Apple's next-generation generative AI models across text, vision, and multimodal applications in global markets. Working within the Responsible AI group, you'll collaborate with cross-functional teams to identify risks, measure impact, and implement regional mitigations.

The position involves:

  • Developing metrics for evaluating safety and fairness risks in generative models
  • Designing and scaling datasets through human and synthetic generation methods
  • Collaborating with engineering, product, and research teams
  • Working with policy teams to translate regional requirements into measurable criteria
  • Building expertise in machine translation and cultural alignment
  • Enhancing red teaming and model evaluation processes
  • Working with sensitive content including offensive material

The role offers comprehensive benefits including:

  • Base pay range: $181,100 - $272,100
  • Employee stock programs and purchase options
  • Complete medical and dental coverage
  • Retirement benefits
  • Product discounts and free services
  • Educational expense reimbursement
  • Potential bonuses and relocation assistance

This is an opportunity to directly impact how Apple assesses and improves the safety and cultural alignment of large language and multimodal models across languages and regions.

Last updated a day ago

Responsibilities For AIML - Machine Learning Engineer, Model Evaluations

  • Develop metrics for evaluation of safety and fairness risks in generative models
  • Design datasets and scale data coverage through human and synthetic generation
  • Collaborate with cross-functional teams to align evaluations with feature goals
  • Partner with policy teams on regional safety requirements
  • Build expertise in machine translation and cultural alignment
  • Develop ML-based enhancements to red teaming and model evaluation
  • Work with sensitive and potentially offensive content

Requirements For AIML - Machine Learning Engineer, Model Evaluations

Python
  • MS or PhD in Computer Science, Linguistics, Cognitive Science, HCI, Psychology, Mathematics, Physics, or similar field + 4 years experience, or BA/BS with 8+ years experience
  • Experience collecting and analyzing language data, image data, and/or multi-modal data
  • Strong experience designing human annotation projects and handling complex data
  • Proficiency in data science, machine learning, analytics, and Python & Pandas
  • Excellent interpersonal skills and ability to present to senior leadership
  • Strong skills in model quality metrics development and experiment interpretation

Benefits For AIML - Machine Learning Engineer, Model Evaluations

Medical Insurance
Dental Insurance
Vision Insurance
401k
Education Budget
Equity
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • 401k
  • Education Budget
  • Equity

Interested in this job?