Software Engineer, Model Inference

OpenAI is seeking a Software Engineer for Model Inference to join their Applied AI team. This role focuses on scaling up critical inference infrastructure to efficiently service customer requests for state-of-the-art AI models like GPT-4 and DALL-E.

Key responsibilities include:

• Collaborating with ML researchers, engineers, and product managers to productionize latest technologies
• Improving performance, latency, throughput, and efficiency of deployed models
• Building tools for visibility into bottlenecks and addressing high-priority issues
• Optimizing code and Azure VMs to maximize hardware utilization

The ideal candidate should have:

• Understanding of modern ML architectures and optimization for inference
• At least 3 years of professional software engineering experience
• Expertise in HPC technologies (InfiniBand, MPI, CUDA)
• Experience with production distributed systems
• Ability to work on end-to-end problems and learn new skills as needed

OpenAI offers a competitive compensation package, including equity and comprehensive benefits such as medical insurance, 401(k) matching, unlimited time off, and parental leave. The company values diversity and is committed to creating an inclusive environment for all employees.

Join OpenAI in shaping the future of AI technology and ensuring its benefits are widely shared.