Taro Logo

On-device ML Infrastructure Engineer (ML Insights and Forecasting)

Apple is a technology company that creates innovative hardware, software and services.
$139,500 - $258,100
Machine Learning
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI

Job Description

The On-Device Machine Learning team at Apple is seeking an experienced ML Infrastructure Engineer focused on ML Insights and Forecasting. This role sits at the heart of Apple's on-device machine learning initiatives, working across research, software engineering, hardware engineering, and products.

The team is responsible for building critical infrastructure that enables the Research to Production lifecycle of innovative machine learning models powering user experiences across Apple's platforms. This includes onboarding new ML architectures to embedded devices, developing optimization toolkits, creating ML compilers and runtimes, and building comprehensive benchmarking and debugging toolchains.

As an ML Infrastructure Engineer, you'll explore cutting-edge trends in ML architectures and ensure they run effectively on Apple's on-device stack. You'll build infrastructure for regular testing coverage and work closely with inference stack teams to optimize performance and enable new capabilities. The role offers exciting opportunities to dive into on-device ML research areas like model visualization, efficient inference algorithms, model compression, and ML compilers/runtime systems.

The position requires strong technical skills in Python programming and ML frameworks, along with solid fundamentals in machine learning concepts and quality practices. You'll collaborate extensively with ML and hardware teams across Apple to identify and address gaps in the ML inference stack.

This is an excellent opportunity to work at the forefront of on-device machine learning, contributing to infrastructure that underpins critical ML workflows across Apple's key products including Camera, Siri, Health, Vision, and more. You'll be part of Apple Intelligence, helping to advance the state-of-the-art in efficient, on-device machine learning capabilities.

The role offers competitive compensation including base pay between $139,500 and $258,100, plus additional benefits like stock programs, comprehensive healthcare, education reimbursement, and potential bonuses. Join Apple's world-class team working on next-generation machine learning technologies that directly impact hundreds of millions of users.

Last updated a day ago

Responsibilities For On-device ML Infrastructure Engineer (ML Insights and Forecasting)

  • Explore the latest ML model architectures and prototype getting these running on device
  • Build infrastructure to enable at scale testing of new ML features
  • Analyze achieved performance vs roofline models on Apple's hardware
  • Analyze telemetry data to understand how users are using ML on device
  • Identify gaps in today's ML inference stack and work with XF teams to prioritize and address these
  • Collaborate extensively with ML and hardware teams across Apple

Requirements For On-device ML Infrastructure Engineer (ML Insights and Forecasting)

Python
  • Bachelors in Computer Science or relevant subject areas
  • Experience with ML frameworks (PyTorch, TensorFlow, JAX, etc.)
  • Strong programming and software design skills in Python
  • In depth knowledge of quality practices and fundamentals
  • Solid ML fundamentals including training regimes, evaluation and deployment/inference
  • Excellent collaboration and communication skills

Benefits For On-device ML Infrastructure Engineer (ML Insights and Forecasting)

Medical Insurance
Dental Insurance
Vision Insurance
401k
Equity
Education Budget
  • Comprehensive medical and dental coverage
  • Vision insurance
  • Retirement benefits
  • Employee stock programs
  • Education reimbursement
  • Discretionary bonuses
  • Relocation benefits

Related Jobs

AIML - Machine Learning Engineer, Web Indexing team

Senior Machine Learning Engineer position at Apple, focusing on web indexing and search infrastructure, offering competitive salary range of $147,400-$272,100 with comprehensive benefits.

Computer Vision and Machine Learning Engineer

Senior Computer Vision and Machine Learning Engineer role at Apple, focusing on real-time computer vision and ML algorithms for AR/VR applications.

AIML - Sr. Software Engineer - AIML Observability

Senior Software Engineer role focused on building AI-powered observability solutions at Apple, working on cloud-native technologies and large-scale distributed systems.

Software Engineer - GenAI Evaluations, AiDP

Senior Software Engineer role at Apple focusing on Generative AI evaluations and frameworks, offering competitive compensation between $171,600-$302,200.

AIML - Machine Learning Engineer, Web Indexing team

Senior Machine Learning Engineer position at Apple, focusing on web indexing and search infrastructure, offering $139.5K-$258.1K plus benefits.