Taro Logo

Senior Software Engineer - Distributed Data Systems

Databricks is the data and AI company that enables organizations to unify and democratize data, analytics and AI, serving over 10,000 organizations worldwide including 50% of Fortune 500.
$157,700 - $213,800
Senior Software Engineer
In-Person
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS · Data

Description For Senior Software Engineer - Distributed Data Systems

At Databricks, we're building the next generation of distributed data storage and processing systems that power the world's most sophisticated data and AI workloads. As a Senior Software Engineer on the Runtime team, you'll be working on cutting-edge technology that combines high-performance SQL query capabilities with flexible programming abstractions for diverse workloads from ETL to data science.

You'll be contributing to major projects like Apache Spark™, the industry standard for big data processing, Delta Lake which provides ACID transactions and time travel capabilities, and Delta Pipelines for orchestrating thousands of data pipelines. The role involves building reliable, high-performance services for cloud storage backends like AWS S3 and Azure Blob Store.

We're looking for engineers who are passionate about solving technical challenges in distributed systems and can work towards long-term architectural goals while delivering incremental value. You'll be joining a team that's customer-obsessed and focused on enabling data teams to solve the world's toughest problems - from revolutionizing transportation to accelerating medical breakthroughs.

The position offers competitive compensation ($157,700 - $213,800) and comprehensive benefits. You'll be working at a rapidly growing company trusted by over 10,000 organizations worldwide, including 50% of Fortune 500 companies. If you have strong experience in Java/Scala, distributed systems, and a passion for building high-performance data systems, this is an opportunity to make a significant impact at scale.

Last updated 9 hours ago

Responsibilities For Senior Software Engineer - Distributed Data Systems

  • Build next generation distributed data storage and processing systems
  • Develop Apache Spark™ framework
  • Work on Data Plane Storage services and client libraries
  • Develop Delta Lake storage management system
  • Build Delta Pipelines for orchestrating data pipelines
  • Performance engineering for query optimizer and execution engine

Requirements For Senior Software Engineer - Distributed Data Systems

Java
Scala
  • BS (or higher) in Computer Science, related technical field or equivalent practical experience
  • Comfortable working towards a multi-year vision with incremental deliverables
  • Motivated by delivering customer value and impact
  • 5+ years of production level experience in either Java, Scala or C++
  • Strong foundation in algorithms and data structures and their real-world use cases
  • Experience with distributed systems, databases, and big data systems (Apache Spark, Hadoop)

Benefits For Senior Software Engineer - Distributed Data Systems

Medical Insurance
Dental Insurance
Vision Insurance
  • Comprehensive benefits package
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance

Interested in this job?

Jobs Related To Databricks Senior Software Engineer - Distributed Data Systems