Taro Logo

ML Infrastructure Software Engineer

Apple is a technology company that designs, develops, and sells consumer electronics, software, and services.
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
10+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For ML Infrastructure Software Engineer

Join Apple's Silicon Technologies group as an ML Infrastructure Software Engineer focused on AI-driven solutions. In this highly visible role, you'll be responsible for deploying and integrating AI models supporting silicon design workflows. You'll work on optimizing and scaling machine learning infrastructure, collaborate with internal teams on model selection and benchmarking, and contribute to critical hardware decisions. This role combines deep ML expertise with infrastructure engineering to support Apple's cutting-edge silicon development.

The position requires strong Python skills and experience with modern ML deployment frameworks. You'll be working with industry-standard AI models, managing fine-tuning pipelines, and ensuring efficient model deployment at scale. Your work will directly impact Apple's ability to leverage AI in silicon design, making this a unique opportunity to shape the future of Apple's hardware capabilities.

As part of the Hardware team, you'll collaborate across functions to evaluate model needs, implement monitoring solutions, and drive the adoption of internal chip solutions. This role offers the chance to work on complex technical challenges while contributing to Apple's industry-leading silicon technologies. The ideal candidate brings both technical depth in ML infrastructure and the ability to drive cross-functional initiatives from concept to production.

Join us to help build the technology that fuels Apple's devices, ensuring our products can seamlessly and efficiently handle the tasks that make them beloved by millions. This role offers the opportunity to work with cutting-edge AI technologies while contributing to Apple's reputation for excellence in hardware innovation.

Last updated 2 days ago

Responsibilities For ML Infrastructure Software Engineer

  • Deploying, optimizing, and integrating industry-standard AI models within internal infrastructure
  • Collaborating with internal teams to evaluate model needs and define selection standards
  • Managing pipelines for fine-tuning and model conversion
  • Contributing to compute planning and hardware decisions
  • Implementing monitoring to ensure scalable and efficient model deployment

Requirements For ML Infrastructure Software Engineer

Python
  • Experience in Python
  • Experience with model deployment frameworks (VLLM, Triton, or TensorRT-LLM)
  • Experience scaling and optimizing machine learning models in production environments
  • BS and 10+ years of relevant industry experience

Interested in this job?