Staff Software Engineer - Data Platform

Databricks is seeking a Staff Software Engineer to join their Data Platform team, focusing on building the Data Intelligence Platform. This role is crucial in automating decision-making across the entire company through developing various tools for logging, orchestration, data transformation, metric store, and governance platforms. The position involves working with cutting-edge Databricks products and other tools in the data ecosystem.

The role requires building and operating one of the largest scale software platforms, handling millions of virtual machines and processing exabytes of data daily. The successful candidate will be responsible for designing and running the Databricks metrics store, managing the cross-company Data Intelligence Platform, and developing infrastructure to efficiently run Databricks at scale across multiple clouds and geographies.

Key responsibilities include designing ETL frameworks, partnering with engineering teams for product vision, and establishing conventions for telemetry and audit logging. The ideal candidate should have 12+ years of industry experience, with 6+ years in technical leadership on large projects involving ETL frameworks, metrics stores, and infrastructure management.

At Databricks, you'll be part of a company that serves over 10,000 organizations worldwide, including major corporations and Fortune 500 companies. The company was founded by the original creators of Lakehouse, Apache Spark™, Delta Lake, and MLflow, and maintains a strong commitment to innovation in data and AI technology.