Taro Logo

ML Infrastructure Software Engineer

A leading technology company that designs and develops consumer electronics, software, and services.
$181,100 - $318,400
Machine Learning
Staff Software Engineer
In-Person
5,000+ Employees
10+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:

Description For ML Infrastructure Software Engineer

Apple's Silicon Technologies group is seeking a passionate ML Infrastructure Software Engineer to join their team in building AI-driven solutions that power Apple's devices. This role focuses on enabling the deployment and integration of AI models supporting various domains within Apple's ecosystem.

As an ML Infrastructure Software Engineer, you'll be working at the intersection of machine learning and infrastructure, helping to create elegant solutions to complex challenges. Your work will directly impact how Apple products and services handle AI tasks that millions of users rely on daily.

Key responsibilities include deploying and optimizing industry-standard AI models within internal infrastructure, managing model pipelines, and making strategic decisions about compute resources and hardware. You'll collaborate closely with internal teams to evaluate model needs, establish benchmarking standards, and ensure Apple's infrastructure remains cutting-edge.

The ideal candidate brings extensive experience in Python and machine learning model deployment frameworks like VLLM, Triton, or TensorRT-LLM. You should have a proven track record of scaling ML models in production environments and deep understanding of model optimization techniques.

This role offers competitive compensation ranging from $181,100 to $318,400 base salary, plus additional benefits including stock options, comprehensive healthcare, and education reimbursement. Join Apple's team in Cupertino and be part of shaping the future of AI integration in consumer technology.

The position requires a minimum of 10 years of relevant industry experience and a BS degree. You'll be working in a collaborative environment where attention to detail and passion for technology excellence are highly valued. This is an opportunity to make a significant impact on Apple's AI infrastructure while working with cutting-edge technology and talented teams.

Last updated 2 days ago

Responsibilities For ML Infrastructure Software Engineer

  • Deploying, optimizing, and integrating industry-standard AI models within internal infrastructure
  • Collaborating with internal teams to evaluate model needs and define selection standards
  • Managing pipelines for fine-tuning and model conversion
  • Contributing to compute planning and hardware decisions
  • Implementing monitoring to ensure scalable and efficient model deployment

Requirements For ML Infrastructure Software Engineer

Python
Kubernetes
  • Experience in Python
  • Experience with model deployment frameworks: VLLM, Triton, or TensorRT-LLM
  • Experience scaling and optimizing machine learning models in production environments
  • BS and 10+ years of relevant industry experience
  • Understanding of model optimization techniques
  • Familiarity with containerization and orchestration tools
  • Proven track record of leading complex ML infrastructure projects
  • Ability to evaluate model choices based on hardware efficiency
  • Exposure to performance monitoring and observability systems
  • Designed and optimized RESTful services

Benefits For ML Infrastructure Software Engineer

Medical Insurance
Dental Insurance
Vision Insurance
401k
Equity
Education Budget
Relocation Benefits
  • Comprehensive medical and dental coverage
  • Retirement benefits
  • Employee stock purchase plan
  • Discretionary restricted stock unit awards
  • Education reimbursement
  • Product discounts
  • Free services
  • Discretionary bonuses
  • Relocation assistance

Interested in this job?