Taro Logo

Software Engineer - GenAI Evaluations, AiDP

Apple is a technology company that designs, develops, and sells consumer electronics, software, and services.
$181,100 - $318,400
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
2+ years of experience
AI

Job Description

Apple is seeking a driven and analytical Software Engineer to join their Generative AI Evaluations team. This role focuses on defining how to measure, monitor, and improve the performance of AI systems that power next-generation user experiences. The position involves designing robust evaluation frameworks, translating cutting-edge research into practical tooling, and collaborating with cross-functional teams to ensure GenAI solutions are trustworthy, efficient, and high-quality.

As a Software Development Engineer on the Evaluations Team, you'll work with a team of skilled engineers to design and develop platform features that help solution developers experiment and identify optimal configurations for GenAI applications. You'll be responsible for evaluating and analyzing performance, translating research into scalable evaluations, and actively participating in all aspects of feature development from ideation to maintenance.

The role requires strong technical expertise in Python programming, experience with FastAPI or similar frameworks, and knowledge of Machine Learning, particularly in areas like Large Language Models (LLMs) and Retrieval Augmented Generation (RAG). You'll need to effectively communicate complex technical topics to diverse audiences and collaborate across teams to drive performance improvements.

This position offers competitive compensation ranging from $181,100 to $318,400, along with comprehensive benefits including medical coverage, retirement benefits, stock options, and education reimbursement. The role is based in either the San Francisco Bay Area or Seattle, providing an opportunity to work at one of the world's leading technology companies while influencing both Apple's AI platforms and the broader standard for evaluating generative applications at scale.

Last updated 10 hours ago

Responsibilities For Software Engineer - GenAI Evaluations, AiDP

  • Design and develop platform features for helping solution developers to experiment and identify optimal configurations for delivering high quality GenAI applications
  • Evaluate and analyze the performance of GenAI applications, and actively collaborate with the team in driving performance improvements
  • Translate the latest research into reliable and scalable evaluations that can deliver high quality experiences for users
  • Actively engage in all aspects of feature development, from ideation and experimentation to deployment and maintenance
  • Communicate complex technical topics effectively to a diverse audience

Requirements For Software Engineer - GenAI Evaluations, AiDP

Python
  • Bachelor's in Computer Science, Artificial Intelligence, Machine Learning, or a related field or experience
  • 2+ years of software engineering experience
  • Programming skills in Python
  • Experience developing scalable and robust services with FastAPI or similar frameworks
  • Experience in Machine Learning, with emphasis on Large Language Models (LLMs), Retrieval Augmented Generation (RAG) or GenAI Agents
  • Experience with evaluating and optimizing Generative AI platforms or applications

Benefits For Software Engineer - GenAI Evaluations, AiDP

Medical Insurance
Dental Insurance
Vision Insurance
401k
Education Budget
Equity
Relocation Benefits
  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Discounted products and free services
  • Education reimbursement
  • Stock options and employee stock purchase plan
  • Discretionary bonuses
  • Relocation assistance

Related Jobs

Software Development Engineer - Test

Software Development Engineer in Test role at Apple focusing on quality assurance for on-device machine learning technologies, offering competitive pay and benefits.

Physical Design Engineer, Machine Learning

Physical Design Engineer role at Apple, combining machine learning expertise with processor design to optimize next-generation SOCs for power, performance, and area efficiency.

AIML - Machine Learning Engineer, Batch processing team

Machine Learning Engineer role at Apple focusing on batch processing and AI model evaluation, offering competitive pay and benefits in San Francisco or Seattle.

AIML - Machine Learning Engineer, Batch processing team

Machine Learning Engineer position at Apple working on AI model evaluation and batch processing systems for Siri and other Apple products.

Quality Engineer - Machine Learning

Quality Engineer position at Apple focusing on machine learning model testing, validation, and quality assurance for location-based technologies.