Software Engineer, ML Developer Experience

Anyscale commercializes Ray, an open-source project for scalable machine learning, making distributed computing accessible to developers.
$180,000 - $273,000
Machine Learning
Mid-Level Software Engineer
Hybrid
101 - 500 Employees
2+ years of experience
AI · Enterprise SaaS

Description For Software Engineer, ML Developer Experience

Anyscale is revolutionizing distributed computing through Ray, a popular open-source project creating an ecosystem of libraries for scalable machine learning. Used by industry giants like OpenAI, Uber, Spotify, Instacart, and Cruise, Ray is transforming how AI applications are deployed in the real world.

As a Software Engineer in the ML Developer Experience team, you'll be at the forefront of creating tools and services that enable users to build production-quality applications using Ray. This role combines product development with infrastructure engineering, focusing on building a polished, stable, and well-designed platform that delivers a magical developer experience.

The position involves working on critical components including Anyscale workspaces, production and development tools, ML Ops tools, and various integrations. You'll be responsible for building out essential infrastructure and architecture needed to power the platform at scale. The ideal candidate should have a strong technical background, understanding of user needs, and passion for creating exceptional developer experiences.

Working at Anyscale means joining a well-funded startup (backed by Andreessen Horowitz, NEA, and Addition with $250+ million raised) that's democratizing distributed computing. You'll be part of a team that's making complex distributed systems accessible to developers of all skill levels, helping to shape the future of AI application development and deployment.

The role offers an opportunity to work on cutting-edge ML infrastructure, contribute to open-source projects, and build tools that power the next generation of AI applications. With a combination of technical challenges and user-focused development, this position is perfect for engineers who want to make a significant impact in the ML/AI infrastructure space.

Last updated 27 minutes ago

Responsibilities For Software Engineer, ML Developer Experience

  • Develop a next-gen ML Ops platform and development tooling centered around Ray
  • Build tools and frameworks for managing the AI development lifecycle from data preparation to training to production serving
  • Full stack work on Anyscale workspaces, debugging and dependency management
  • Development of new ML Ops tooling and capabilities, like dataset management, experiment and lineage tracking
  • Lead the development of the Anyscale SDK, authentication, etc.

Requirements For Software Engineer, ML Developer Experience

Python
  • A solid background in algorithms, data structures, and system design
  • Experience working with modern machine learning tooling, including PyTorch, MLFlow, data catalogs, etc.
  • At least 2+ year of relevant work experience

Benefits For Software Engineer, ML Developer Experience

Equity
  • Equity (Company has raised $250+ million to date)

Interested in this job?

Jobs Related To Anyscale Software Engineer, ML Developer Experience

AI Engineer - Business Transformation

Lead automation and AI implementation across HappyCo's business operations, building internal tools and AI-driven workflows to streamline processes and drive efficiency.

AI Engineer / Workflow Automations

AI Engineer position focusing on implementing practical AI solutions and workflow automations using Python, LLMs, and cloud services for e-commerce operations.

Machine Learning Engineer II, StoreGen

Machine Learning Engineer II position at Amazon's StoreGen team, focusing on AI-powered software development tools and practices with competitive compensation and benefits.

Machine Learning Engineer, Generative AI Innovation Center

Join AWS's Generative AI Innovation Center as a Machine Learning Engineer to develop and optimize custom LLMs, working with enterprise customers to deliver transformative AI solutions.

Amazon Q Delivery Engineer, Amazon Q Customer Success Team (Q-CST)

AWS Delivery Engineer position focusing on implementing Generative AI solutions using Amazon Q and Bedrock, combining technical expertise with customer success.