Taro Logo

ML Infrastructure Engineer

AI research and deployment company dedicated to ensuring general-purpose artificial intelligence benefits humanity
$310,000 - $555,000
Machine Learning
Senior Software Engineer
Hybrid
1,000 - 5,000 Employees
5+ years of experience
AI

Job Description

OpenAI is seeking a Senior ML Infrastructure Engineer to join their Sora team, working at the cutting edge of AI development. This role combines advanced software engineering with machine learning infrastructure, focusing on building systems that enable large-scale ML capabilities from the ground up.

The position offers an exciting opportunity to work at the intersection of research and infrastructure, where you'll be designing and implementing systems that power high-impact, cross-functional initiatives. As part of the Sora team, you'll be responsible for creating and maintaining distributed systems for large-scale training and inference, while ensuring robust, reliable, and performant infrastructure that supports rapid experimentation.

The role requires expertise in distributed systems, performance optimization, and reliability engineering. You'll be working closely with ML engineers and researchers to deploy models at scale, building infrastructure that supports low-latency, high-throughput pipelines. The ideal candidate should have experience in building or re-architecting complex infrastructure systems from the ground up.

OpenAI offers an exceptional compensation package, including a competitive salary range of $310K – $555K, plus equity and performance-related bonuses. The benefits package is comprehensive, featuring medical, dental, and vision insurance, 401(k) with employer match, generous parental leave, flexible PTO, and various other perks including daily meals and learning stipends.

Based in San Francisco with a hybrid work model (3 days in office), this role provides an opportunity to work with world-class talent while contributing to OpenAI's mission of ensuring that general-purpose artificial intelligence benefits all of humanity. The company maintains a strong commitment to diversity, equality, and inclusion, making it an ideal workplace for professionals looking to make a significant impact in the field of AI while enjoying excellent work-life balance and career growth opportunities.

Last updated a day ago

Responsibilities For ML Infrastructure Engineer

  • Design and maintain distributed systems for large-scale training and inference
  • Build infrastructure to support low-latency, high-throughput pipelines
  • Collaborate with applied teams to integrate and scale new capabilities in production

Requirements For ML Infrastructure Engineer

Python
  • Have built or re-architected complex infrastructure systems from the ground up
  • Have expertise in distributed systems, performance optimization, and reliability
  • Are comfortable working closely with ML engineers and researchers to deploy models at scale

Benefits For ML Infrastructure Engineer

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
Mental Health Assistance
Education Budget
Relocation Benefits
Commuter Benefits
  • Medical, dental, and vision insurance with employer HSA contributions
  • Pre-tax accounts for Health FSA, Dependent Care FSA, and commuter expenses
  • 401(k) retirement plan with employer match
  • Paid parental leave (up to 24 weeks for birth parents, 20 weeks for non-birthing parents)
  • Flexible PTO
  • 13+ paid company holidays
  • Mental health and wellness support
  • Employer-paid basic life and disability coverage
  • Annual learning and development stipend
  • Daily meals in offices and meal delivery credits
  • Relocation support
  • Charitable donation matching
  • Wellness stipends