Taro Logo

ML Infrastructure Software Engineer

A leading technology company that designs, develops, and sells consumer electronics, software, and services.
$147,400 - $272,100
Machine Learning
Mid-Level Software Engineer
In-Person
5,000+ Employees
3+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For ML Infrastructure Software Engineer

Apple's Silicon Technologies group is seeking an ML Infrastructure Software Engineer to build AI-driven solutions that solve pressing business challenges. This role focuses on enabling the deployment and integration of AI models supporting various domains within Apple. The position involves working with cutting-edge AI technologies to support silicon design workflows.

As an ML Infrastructure Software Engineer, you'll be responsible for deploying and optimizing industry-standard AI models, collaborating with internal teams on model selection and benchmarking, and managing fine-tuning pipelines. You'll work directly with hardware teams to evaluate compute requirements and support the adoption of internal chip solutions.

The role offers a competitive base salary range of $147,400 - $272,100, along with comprehensive benefits including medical/dental coverage, retirement benefits, and stock programs. You'll have opportunities to work with state-of-the-art AI infrastructure while contributing to the technology that powers Apple's devices.

This is an excellent opportunity for someone with strong Python skills and experience in model deployment frameworks like VLLM, Triton, or TensorRT-LLM. The ideal candidate will have 3+ years of relevant industry experience and a track record of scaling ML models in production environments.

Join Apple's engineering team and be part of developing the next generation of AI infrastructure that supports the company's innovative products and services. You'll work in Cupertino, California, collaborating with talented teams and having access to cutting-edge resources and technologies.

Last updated 2 days ago

Responsibilities For ML Infrastructure Software Engineer

  • Deploying, optimizing, and integrating industry-standard AI models within internal infrastructure to support silicon design workflows
  • Collaborating with internal teams to evaluate model needs, define selection and benchmarking standards
  • Managing pipelines for fine-tuning and model conversion
  • Contributing to compute planning and hardware decisions

Requirements For ML Infrastructure Software Engineer

Python
Kubernetes
  • Experience in Python
  • Experience with at least one of the following model deployment frameworks: VLLM, Triton, or TensorRT-LLM
  • Experience scaling or optimizing machine learning models in production environments
  • Minimum requirement of BS and 3+ years of relevant industry experience

Benefits For ML Infrastructure Software Engineer

Medical Insurance
Dental Insurance
401k
Equity
Education Budget
Relocation Benefits
  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Employee stock programs
  • Education reimbursement
  • Discretionary bonuses
  • Relocation assistance

Interested in this job?