Research Engineer, Prompting

Anthropic's mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole.
$315,000 - $510,000
Machine Learning
Senior Software Engineer
Hybrid
5+ years of experience
This job posting may no longer be active. You may be interested in these related jobs instead:
Machine Learning Systems Engineer, RL Engineering

Senior ML Systems Engineer role at Anthropic focused on building and improving reinforcement learning systems for AI model training

Research Engineer, Knowledge Team

Senior Research Engineer position at Anthropic focused on redesigning how AI systems interact with external data sources through innovative information architectures and LLM training.

Research Engineer, Frontier Red Team (RSP Evaluations)

Senior Research Engineer position at Anthropic focusing on AI safety evaluations and implementing responsible scaling policies for frontier AI models.

Software Engineer

Senior Software Engineering role at Anthropic focusing on building and optimizing large-scale ML systems, with emphasis on AI safety and interpretability.

Sr. Software Dev. Engineer/MLE, AGI Customization

Senior Machine Learning Engineer role at Amazon's AGI team, focusing on LLM customization, fine-tuning, and distillation, requiring 5+ years of software development experience.

Description For Research Engineer, Prompting

Anthropic is seeking a Research Engineer specializing in Prompting to join their team. This role focuses on developing and optimizing prompting techniques for AI models, particularly large language models like Claude. The ideal candidate will have experience in ML research or software engineering, familiarity with language model architecture, and a passion for making powerful technology safe and beneficial.

Key responsibilities include:

  • Developing automated prompting techniques
  • Finetuning new capabilities into Claude
  • Leading automated evaluation of Claude models and prompts
  • Optimizing data mixes for model training
  • Creating and maintaining infrastructure for prompt iteration and testing
  • Developing future Anthropic products built on Claude

The role requires significant ML research or software engineering experience, extensive experience with language model behavior, and strong communication skills. Advanced degrees in technical fields or relevant non-technical fields with programming experience are preferred.

Anthropic offers a competitive compensation package, including salary, equity, and comprehensive benefits. The company values diversity and encourages applications from underrepresented groups. They have a hybrid work model, expecting staff to be in the office at least 25% of the time.

This is an opportunity to work on cutting-edge AI technology with a focus on safety and societal benefit, in a collaborative environment that values impact and empirical science approaches to AI research.

Last updated 9 months ago

Responsibilities For Research Engineer, Prompting

  • Develop automated prompting techniques for our models (eg extensions to the Metaprompter)
  • Finetune new capabilities into Claude that maximize Claude's performance or ease of use given particular prompting innovations
  • Lead automated evaluation of Claude models and prompts across the training and product lifecycle
  • Help create and optimize data mixes for model training
  • Develop and systematically test new, creative, and original prompting strategies for a wide range of research tasks
  • Help to create and maintain the infrastructure required for efficient prompt iteration and testing
  • Develop future Anthropic products built on top of Claude
  • Stay up-to-date with the latest research in prompting and model orchestration, and share knowledge with the team

Requirements For Research Engineer, Prompting

Python
  • Significant ML research or software engineering experience
  • At least a high level familiarity with the architecture and operation of large language models
  • Extensive prior experience exploring and testing language model behavior
  • Experience prompting and/or building products with language models
  • Good communication skills
  • Passion for making powerful technology safe and societally beneficial
  • Stay up-to-date and informed by taking an active interest in emerging research and industry trends
  • Enjoy pair programming

Benefits For Research Engineer, Prompting

Medical Insurance
Dental Insurance
Vision Insurance
401k
Education Budget
Parental Leave
  • Comprehensive health, dental, and vision insurance
  • 401(k) plan with 4% matching
  • 22 weeks of paid parental leave
  • Unlimited PTO
  • Stipends for education, home office improvements, commuting, and wellness
  • Fertility benefits via Carrot
  • Daily lunches and snacks in the office
  • Relocation support for those moving to the Bay Area

Interested in this job?