Senior Software Engineer - Distributed Data Systems

Databricks is seeking a Senior Software Engineer to join their Runtime team, focusing on distributed data systems. This role is perfect for engineers passionate about building high-performance, scalable data infrastructure. You'll work on cutting-edge projects including Apache Spark™, Delta Lake, and data pipeline orchestration systems that power some of the world's largest organizations. The position offers the opportunity to shape the future of data processing by developing systems that combine SQL query performance with flexible programming abstractions for diverse workloads.

The role involves working on critical projects like developing the Apache Spark™ framework, building reliable data plane storage services, enhancing Delta Lake's ACID transaction capabilities, and creating sophisticated query optimization engines. You'll be part of a team that's pushing the boundaries of what's possible in distributed data systems, working with modern cloud technologies and solving complex technical challenges.

Databricks offers competitive compensation ($166,000 - $225,000 base salary) and comprehensive benefits. The company has a strong engineering culture, founded by the creators of Apache Spark™, Delta Lake, and MLflow. You'll be working in San Francisco, collaborating with world-class engineers to build solutions used by over 10,000 organizations worldwide, including 50% of the Fortune 500.

This is an excellent opportunity for experienced engineers who want to make a significant impact on the future of data and AI infrastructure, working on systems that process massive amounts of data while maintaining high performance and reliability standards.