Taro Logo

AIML - Machine Learning Engineer, Foundation Model Services

A technology company that designs, develops, and sells consumer electronics, software, and services.
$181,100 - $318,400
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For AIML - Machine Learning Engineer, Foundation Model Services

Apple's Foundation Model Infrastructure team, within Machine Learning Platform Technologies organization, is seeking a Machine Learning Engineer to join their team. This role is at the heart of Apple Intelligence, building frameworks, services and tools that power Apple's largest foundation models on servers. The infrastructure supports a wide range of services including Apple Search, Apple Music, AppleTV, AppStore, iMessages, Photos & Camera, Spotlight, Safari, Siri and upcoming products, serving millions of queries daily with low latency.

As a Machine Learning Engineer, you'll work on optimizing billions of parameter language, vision, and speech models using state-of-the-art technologies at Apple's scale. You'll collaborate with the Foundation Model Research team to optimize inference for cutting-edge model architectures and work closely with product teams to build production-grade solutions serving millions of customers in real-time.

The ideal candidate brings 5+ years of experience in complex project leadership, deep expertise in high-throughput services at supercomputing scale, and strong proficiency in cloud technologies and ML frameworks. You'll have the opportunity to make a direct impact on billions of users worldwide while working with cutting-edge AI technologies.

The role offers a competitive base salary range of $181,100 to $318,400, plus comprehensive benefits including medical coverage, retirement benefits, stock options, and education reimbursement. Join Apple's team to push the boundaries of computing and intelligence while building products that bring smiles to people's faces.

Last updated 5 days ago

Responsibilities For AIML - Machine Learning Engineer, Foundation Model Services

  • Work alongside Foundation Model Research team to optimize inference for cutting edge model architectures
  • Work closely with product teams to build Production grade solutions
  • Build tools to understand bottlenecks in Inference for different hardwares and use cases
  • Mentor and guide engineers in the organization

Requirements For AIML - Machine Learning Engineer, Foundation Model Services

Python
Kubernetes
  • 5+ years of experience leading and driving complex, ambiguous projects
  • Experience with high throughput services at supercomputing scale
  • Proficient with running applications on Cloud using Kubernetes, Docker
  • Familiar with GPU programming concepts using CUDA
  • Familiar with ML Frameworks like Pytorch, Tensorflow
  • Proficient in building systems written in modern languages (Golang, python)
  • Familiar with Deep Learning architectures like Transformers
  • Experience with Nvidia TensorRT-LLM, vLLLM, DeepSpeed, Nvidia Triton Server

Benefits For AIML - Machine Learning Engineer, Foundation Model Services

Medical Insurance
Dental Insurance
Vision Insurance
401k
Education Budget
Equity
Relocation Benefits
  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Discounted products and free services
  • Education reimbursement
  • Stock options and employee stock purchase plan
  • Discretionary bonuses
  • Relocation assistance

Interested in this job?