HW/SW Co-Design Engineer
Description For HW/SW Co-Design Engineer
OpenAI is seeking a Senior HW/SW Co-Design Engineer to join their Research Platform team in San Francisco. This role is part of a new team focused on hardware optimization and co-design with partners, making it an exciting opportunity to shape the future of AI hardware infrastructure.
The position offers a competitive compensation package of $360K-$530K plus equity and comprehensive benefits. As a founding engineer on this team, you'll be responsible for co-designing future hardware architectures, optimizing performance for AI workloads, and working closely with kernel, compiler, and machine learning engineers to understand and implement their needs.
The ideal candidate brings 4+ years of industry experience in compute scale or semiconductor development, with deep expertise in GPU/AI accelerators and software/hardware co-design. You'll work in a hybrid environment (3 days in office) with some of the brightest minds in AI, focusing on critical challenges like maximizing HBM bandwidth, optimizing for low arithmetic intensity, and developing expressive SIMD ISA.
This role offers unique opportunities to influence the future of AI hardware development, working directly with hardware vendors and internal teams to optimize platforms for OpenAI's cutting-edge workloads. You'll be involved in everything from developing performance estimates and simulations to managing partner relationships and influencing hardware roadmaps.
The position is ideal for someone with strong technical skills in C/C++ and Python, experience with CUDA or similar accelerator programming languages, and a deep understanding of machine learning systems. A PhD in Computer Science with a focus on Computer Architecture, Parallel Computing, or Compilers is preferred but not required.
OpenAI offers an exceptional benefits package including comprehensive health coverage, mental health support, generous parental leave, unlimited PTO, and a learning development stipend. The company's mission-driven approach and commitment to safe, beneficial AGI development makes this an opportunity to work on technology that could fundamentally impact humanity's future.
If you're passionate about hardware optimization, have a strong technical background, and want to work at the forefront of AI development, this role offers the perfect blend of technical challenge and meaningful impact.
Responsibilities For HW/SW Co-Design Engineer
- Co-design future hardware for programmability and performance with hardware vendors
- Assist hardware vendors in developing optimal kernels and add support for it in our compiler
- Develop performance estimates for critical kernels for different hardware configurations
- Work with machine learning engineers, kernel engineers and compiler developers
- Manage communication and coordination with internal and external partners
- Influence the roadmap of hardware partners to optimize them for OpenAI's workloads
- Evaluate potential partners' accelerators and platforms
- Build simulations and performance models
- Influence roadmaps for hardware partners for datacenter networks, racks, and buildings
Requirements For HW/SW Co-Design Engineer
- 4+ years of industry experience in harnessing compute at scale or building semiconductors
- Strong experience in software/hardware co-design
- Deep understanding of GPU and/or other AI accelerators
- Experience with CUDA or related accelerator programming language
- Experience driving Machine Learning accuracy with low precision formats
- Experience aligning future hardware with HPC infrastructure
- Familiar with fundamentals of deep learning computing and chip microarchitecture
- Ability to collaborate with ML engineers, kernel writers and compiler developers
- Strong coding skills in C/C++ and Python
- PhD in Computer Science and Engineering (preferred)
- Strong understanding of LLMs and challenges related to their training and inference
Benefits For HW/SW Co-Design Engineer
- Medical, dental, and vision insurance for you and your family
- Mental health and wellness support
- 401(k) plan with 4% matching
- Unlimited time off and 18+ company holidays per year
- Paid parental leave (20 weeks) and family-planning support
- Annual learning & development stipend ($1,500 per year)
- Generous equity
