Taro Logo

Software Engineer - Compiler, Kernels, Runtime

AI research and deployment company dedicated to ensuring general-purpose artificial intelligence benefits humanity
$310,000 - $550,000
Backend
Staff Software Engineer
Hybrid
1,000 - 5,000 Employees
8+ years of experience
AI

Description For Software Engineer - Compiler, Kernels, Runtime

OpenAI is seeking a skilled Software Engineer to join their Scaling team, focusing on compiler development, kernel optimization, and runtime systems. This role is central to building and optimizing the low-level stack that powers OpenAI's ML training infrastructure across their supercomputing clusters.

The position offers an exciting opportunity to work at the intersection of systems programming, ML infrastructure, and high-performance computing. You'll be responsible for designing high-performance runtimes, building custom kernels, contributing to compiler infrastructure, and developing scalable simulation systems. The role requires balancing user-friendly developer APIs with highly efficient runtime systems.

As part of the Scaling team, you'll be instrumental in developing foundational components that maximize the productivity of researchers and hardware utilization. The team's mission is to accelerate progress toward AGI by enabling the fastest iteration cycles and highest throughput for model development at scale.

The role offers a competitive compensation package ranging from $310K to $550K, plus equity and comprehensive benefits including medical, dental, and vision insurance, mental health support, and a 401(k) with 50% matching. The position is based in San Francisco with a hybrid work model (3 days/week in-office), and relocation assistance is available.

Ideal candidates should have deep expertise in systems programming languages like Rust and C++, along with Python proficiency. Experience in compiler development, kernel authoring, accelerator programming, or high-performance simulation is highly valued. The role requires someone who thrives in a fast-paced environment and is passionate about optimizing large-scale systems.

Working at OpenAI means joining a company at the forefront of AI development, with a strong commitment to ensuring AI benefits humanity. The company offers a collaborative environment where you'll work with cutting-edge technology and contribute to groundbreaking advancements in artificial intelligence.

Last updated 3 minutes ago

Responsibilities For Software Engineer - Compiler, Kernels, Runtime

  • Design and build APIs and runtime components to orchestrate computation and data movement across heterogeneous ML workloads
  • Contribute to compiler infrastructure, including optimizations and compiler passes
  • Engineer and optimize compute and data kernels
  • Profile and optimize system bottlenecks
  • Develop simulation infrastructure
  • Rapidly deploy runtime and compiler updates
  • Work across a diverse stack using Rust and Python

Requirements For Software Engineer - Compiler, Kernels, Runtime

Python
Rust
  • Proficiency in systems programming (e.g., Rust, C++) and Python
  • Experience in compiler development, kernel authoring, accelerator programming, runtime systems, distributed systems, or high-performance simulation
  • Strong interest in large-scale systems optimization
  • Ability to work in a fast-paced, collaborative environment
  • Values engineering excellence and thoughtful system design

Benefits For Software Engineer - Compiler, Kernels, Runtime

Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Assistance
401k
Parental Leave
Education Budget
  • Medical, dental, and vision insurance for you and your family
  • Mental health and wellness support
  • 401(k) plan with 50% matching
  • Generous time off and company holidays
  • 24 weeks paid birth-parent leave & 20-week paid parental leave
  • Annual learning & development stipend ($1,500 per year)
  • Equity compensation
  • Relocation assistance available

Interested in this job?

Jobs Related To OpenAI Software Engineer - Compiler, Kernels, Runtime

Infrastructure Software Engineer, Leverage Engineering

Senior infrastructure engineering role at OpenAI focusing on scaling internal products with emphasis on reliability, operability, and performance optimization.

Software Engineer, Inference - TL

Technical Lead Software Engineer position at OpenAI focusing on inference infrastructure optimization and CUDA development, offering $460K-$685K plus equity and benefits.

Infrastructure Software Engineer, Leverage Engineering

Senior infrastructure engineering role at OpenAI focusing on scaling internal products with emphasis on reliability, operability, and performance optimization.

Software Engineer, Inference - TL

Technical Lead Software Engineer position at OpenAI focusing on inference infrastructure optimization and CUDA development, offering $460K-$685K plus equity and benefits.

Staff Software Engineer (Remote US Based)

Staff Software Engineer position at BD, working remotely on healthcare technology solutions. Lead and develop critical software systems while contributing to medical technology advancement.