Taro Logo

Staff Software Engineer - Distributed Data Systems

A data and AI company that provides a unified data analytics platform, founded by the creators of Apache Spark, serving over 10,000 organizations worldwide.
$192,000 - $260,000
Staff Software Engineer
In-Person
1,000 - 5,000 Employees
8+ years of experience
Enterprise SaaS · AI

Job Description

Databricks is seeking a Staff Software Engineer to join their Runtime team, focusing on distributed data systems. This role is at the heart of Databricks' mission to enable data teams to solve the world's toughest problems. You'll be working on building next-generation distributed data storage and processing systems that power one of the largest scale software platforms, processing exabytes of data daily.

The position involves working on critical projects like Apache Spark™, Delta Lake, and Delta Pipelines, where you'll be developing systems that combine high performance with reliability at scale. You'll be tackling challenges in data plane storage, performance engineering, and building sophisticated query optimizers.

As a Staff Engineer, you'll be working with a platform that handles millions of virtual machines and must gracefully handle cloud hardware, network, and operating system faults. The role requires deep expertise in distributed systems and databases, with the opportunity to work on technology that serves thousands of organizations, from small businesses to Fortune 100 companies.

The ideal candidate will bring 8+ years of production-level experience in Java, Scala, or C++, combined with strong foundations in algorithms and data structures. You'll be working in San Francisco, contributing to projects that directly impact how modern data analysis is performed, from ETL to data science workloads.

This role offers competitive compensation ($192,000 - $260,000) plus equity and comprehensive benefits. Join a team that's pushing the boundaries of data and AI technology while maintaining the resilience, security, and scale critical for enterprise success.

Last updated 4 days ago

Responsibilities For Staff Software Engineer - Distributed Data Systems

  • Build the next generation distributed data storage and processing systems
  • Develop Apache Spark™ framework
  • Deliver reliable and high performance services for cloud storage backends
  • Work on Delta Lake storage management system
  • Build Delta Pipelines for orchestrating data pipelines
  • Develop next generation query optimizer and execution engine

Requirements For Staff Software Engineer - Distributed Data Systems

Java
Scala
  • BS in Computer Science, related technical field or equivalent practical experience
  • 8+ years of production level experience in either Java, Scala or C++
  • Strong foundation in algorithms and data structures and their real-world use cases
  • Experience with distributed systems, databases, and big data systems (Apache Spark™, Hadoop)
  • Comfortable working towards a multi-year vision with incremental deliverables
  • Driven by delivering customer value and impact

Benefits For Staff Software Engineer - Distributed Data Systems

Medical Insurance
Dental Insurance
Vision Insurance
401k
Equity
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • 401k
  • Equity