GenAI Eval Software Engineer

At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to improve their business.

The Applied AI team at Databricks sits at the forefront of advancing GenAI-powered products. We've launched Databricks Assistant and AI/BI Genie, which are used by hundreds of thousands of Databricks users daily. As a GenAI Eval Software Engineer, you'll be joining our team to build the GenAI Evaluation System — a critical foundation that ensures the quality, reliability, and performance of AI-driven products at scale.

In this role, you'll design and develop systems to evaluate Large Language Models (LLMs) and GenAI applications, enabling rapid experimentation, robust benchmarking, and continuous improvement across our AI products. You'll collaborate with ML engineers, product teams, and researchers to define what "good" looks like for GenAI Applications, driving impact across Databricks's products.

You'll be working at the forefront of GenAI, shaping how AI quality is defined and delivered at scale, while collaborating with world-class engineers and ML experts in a fast-paced, innovative environment. This is an opportunity to contribute to impactful AI products used by enterprises worldwide and be part of a company built on open-source, transparency, and a strong engineering culture.

The role offers competitive compensation with a base salary range of $142,200 — $204,600 USD, along with comprehensive benefits including medical, dental, vision insurance, 401k, equity, and more. Join us in building the future of AI evaluation and quality assurance at scale.