Taro Logo

Machine Learning Systems Engineer, Model APIs

Anthropic creates reliable, interpretable, and steerable AI systems, focusing on safe and beneficial AI development.
$300,000 - $405,000
Machine Learning
Staff Software Engineer
Hybrid
501 - 1,000 Employees
5+ years of experience
AI
This job posting may no longer be active. You may be interested in these related jobs instead:
Research Engineer, Pre-training

Research Engineer position at Anthropic focusing on pre-training large language models, combining cutting-edge AI research with practical engineering implementation.

Machine Learning Systems Engineer, Encodings and Tokenization

Machine Learning Systems Engineer role at Anthropic focusing on developing and optimizing encodings and tokenization systems for AI model training.

Research Engineer, Pre-training

Research Engineer position at Anthropic focusing on pre-training large language models, combining cutting-edge AI research with practical engineering to develop safe and trustworthy AI systems.

Senior Machine Learning Engineer - Experimentation

Senior ML Engineer role at Apple focusing on experimentation platform development, requiring 10+ years of experience in ML, A/B testing, and software development.

Staff Software Engineer (AI)

Staff Software Engineer position at PayPal focusing on AI and compliance platform development, requiring expertise in Java, generative AI, and big data technologies.

Description For Machine Learning Systems Engineer, Model APIs

Anthropic is seeking a Machine Learning Systems Engineer to join their Model APIs team, focusing on building and maintaining critical infrastructure for AI research and evaluation. This role combines software engineering expertise with ML systems development, requiring 5+ years of software engineering experience. The position offers a competitive salary range of $300,000-$405,000 and is based in San Francisco with a hybrid work arrangement (minimum 25% in-office).

The role involves designing and implementing scalable systems for model evaluation and research inference, creating data pipelines, and building tools that enable researchers to effectively assess and develop AI models. Key responsibilities include maintaining Model Evaluations infrastructure, developing Research Inference APIs, and collaborating closely with research teams to understand and meet their evolving needs.

Anthropic's mission centers on creating reliable, interpretable, and steerable AI systems, with a strong focus on safety and beneficial outcomes for society. The company operates as a public benefit corporation and offers comprehensive benefits including competitive compensation, equity donation matching, generous leave policies, and flexible working arrangements.

The ideal candidate will have strong software engineering fundamentals, experience with data infrastructure, and proficiency in Python and cloud platforms. While ML experience is beneficial, strong engineers without ML background are encouraged to apply. The role requires excellent communication skills, independence, and a commitment to responsible AI development.

Working at Anthropic means joining a collaborative team focused on high-impact AI research, with an emphasis on empirical science and practical results. The company values diverse perspectives and encourages applications from candidates of all backgrounds, particularly those from underrepresented groups in tech.

This position offers the opportunity to work on cutting-edge AI systems while contributing to their safe and beneficial development. The role combines technical challenges with meaningful impact, supported by a strong benefits package and a collaborative work environment in San Francisco.

Last updated 20 days ago

Responsibilities For Machine Learning Systems Engineer, Model APIs

  • Design, build, and maintain Model Evaluations infrastructure
  • Develop and optimize APIs and infrastructure for Research Inference
  • Create scalable data pipelines for collecting, processing, and analyzing research outputs
  • Implement monitoring, logging, and performance optimization for research-focused inference systems
  • Build intuitive interfaces and tools for researchers
  • Collaborate with research teams to understand their evolving needs
  • Improve system performance, reliability, and scalability
  • Participate in on-call rotation and deliver operationally ready code
  • Document systems thoroughly

Requirements For Machine Learning Systems Engineer, Model APIs

Python
Kubernetes
  • 5+ years of software engineering experience
  • Experience with data infrastructure and processing large datasets
  • Proficient in Python and experience with cloud infrastructure (AWS, GCP)
  • Excellent communication skills
  • Ability to work independently and take ownership of projects
  • Bachelor's degree in a related field or equivalent experience

Benefits For Machine Learning Systems Engineer, Model APIs

Visa Sponsorship
  • Competitive compensation and benefits
  • Optional equity donation matching
  • Generous vacation and parental leave
  • Flexible working hours
  • Office space in San Francisco
  • Visa sponsorship available

Interested in this job?