Research Engineer, Human Data

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity.
$295,000 - $360,000
Data
Mid-Level Software Engineer
Hybrid
3+ years of experience
This job posting may no longer be active. You may be interested in these related jobs instead:
Business Intel. Engineer III, Customer eXperience Impressions

Senior Business Intelligence Engineer role at Amazon focusing on building analytical systems to measure and improve customer experience through data-driven insights and real-time detection systems.

Business Intelligence Engineer, Wondery

Business Intelligence Engineer role at Wondery, focusing on data analytics and insights for podcast and entertainment content, requiring 3+ years of data analysis experience.

Business Intelligence Engineer II, EU Inbound & Inventory Placement

Business Intelligence Engineer II role at Amazon's EU HQ in Luxembourg, focusing on supply chain analytics and optimization using SQL and data visualization tools.

Business Intelligence Engineer II, EU Inbound & Inventory Placement

Business Intelligence Engineer II position at Amazon's EU HQ in Luxembourg, focusing on supply chain analytics and optimization of inventory placement systems.

Data Engineer, Just Walk Out

Data Engineer position at Amazon's Just Walk Out division, building data infrastructure for checkout-free shopping technology using advanced ML and computer vision.

Description For Research Engineer, Human Data

OpenAI is seeking a Research Engineer for their Human Data Team to drive groundbreaking research and enhance flagship models like ChatGPT, GPT-4, and Sora. This role involves creating custom data solutions, working with AI trainers, and developing scalable methods for generating and evaluating high-quality data across various modalities.

As a Research Engineer, you'll be at the forefront of empirically evaluating model performance and developing human evaluation methodologies. Your responsibilities will include designing and executing evaluations of frontier AI models, writing clean non-ML code for interfaces and pipelines, collaborating with a small team, curating large datasets, and building infrastructure to support and track evaluations.

The ideal candidate should have strong ML engineering skills, research experience, and a deep understanding of Human-Machine Interaction challenges. You should be comfortable in a dynamic, fast-paced research environment and be willing to wear many hats. A B.S. or higher degree in computer science, AI, machine learning, or a related field is required, along with experience in Python and familiarity with frontend technologies.

OpenAI offers a competitive salary range of $295K – $360K, plus generous equity and benefits. The position is based in San Francisco, with a hybrid work model of 3 days in the office per week. Join OpenAI in shaping the future of AI technology and ensuring its benefits are widely shared across humanity.

Last updated 8 months ago

Responsibilities For Research Engineer, Human Data

  • Design, execute, and analyze evaluations of frontier AI models that assess capabilities and safety
  • Write clean non-ML code for building interfaces and pipelines
  • Collaborate closely with a small team
  • Curate large datasets of prompts and investigate coverage of boundary cases
  • Measure the effectiveness of evaluation techniques
  • Build infrastructure, systems and processes for evaluations

Requirements For Research Engineer, Human Data

Python
JavaScript
TypeScript
  • B.S. or other degree in computer science, AI, machine learning, or a related field
  • Experienced in Python
  • Familiar with frontend technologies such as JS/Typescript (or excited to learn)
  • Goal-oriented instead of method-oriented
  • Strongly motivated by OpenAI's mission

Benefits For Research Engineer, Human Data

Medical Insurance
Dental Insurance
Vision Insurance
Mental Health Assistance
401k
Parental Leave
Education Budget
  • Medical, dental, and vision insurance for you and your family
  • Mental health and wellness support
  • 401(k) plan with 50% matching
  • Unlimited time off and 13 company holidays per year
  • Paid parental leave (24 weeks) and family-planning support
  • Annual learning & development stipend ($1,500 per year)

Interested in this job?