Taro Logo

Staff Software Engineer - Distributed Data Systems

Databricks is the data and AI company that enables organizations to unify and democratize data, analytics and AI, founded by the original creators of Apache Spark™, Delta Lake and MLflow.
$192,000 - $260,000
Staff Software Engineer
In-Person
1,000 - 5,000 Employees
8+ years of experience
AI · Enterprise SaaS

Description For Staff Software Engineer - Distributed Data Systems

At Databricks, we are building the next generation of distributed data systems that power some of the world's most sophisticated data and AI workloads. As a Staff Software Engineer on the Runtime team, you'll be working on cutting-edge distributed data storage and processing systems that combine high performance with sophisticated capabilities. You'll be contributing to major projects like Apache Spark™, Delta Lake, and Delta Pipelines, helping to process exabytes of data daily across millions of virtual machines. The role involves building systems that can handle complex workloads from ETL to data science while maintaining high reliability and performance. You'll be working at massive scale, dealing with cloud infrastructure challenges, and developing solutions that must gracefully handle hardware, network, and operating system faults. This is an opportunity to shape the future of data processing at one of the fastest-growing SaaS companies, working alongside the original creators of Apache Spark™. The position offers competitive compensation ($192,000 - $260,000) and comprehensive benefits, making it an excellent opportunity for experienced distributed systems engineers looking to make a significant impact in the big data space.

Last updated a day ago

Responsibilities For Staff Software Engineer - Distributed Data Systems

  • Build the next generation distributed data storage and processing systems
  • Develop Apache Spark™ framework
  • Deliver reliable and high performance services for cloud storage backends
  • Build next generation query optimizer and execution engine
  • Work on Delta Lake storage management system
  • Develop Delta Pipelines for orchestrating data pipelines

Requirements For Staff Software Engineer - Distributed Data Systems

Java
Scala
  • BS in Computer Science, related technical field or equivalent practical experience
  • 8+ years of production level experience in either Java, Scala or C++
  • Strong foundation in algorithms and data structures and their real-world use cases
  • Experience with distributed systems, databases, and big data systems (Apache Spark™, Hadoop)
  • Comfortable working towards a multi-year vision with incremental deliverables
  • Driven by delivering customer value and impact

Benefits For Staff Software Engineer - Distributed Data Systems

Medical Insurance
Dental Insurance
Vision Insurance
401k
  • Medical Insurance
  • Dental Insurance
  • Vision Insurance
  • 401k

Interested in this job?

Jobs Related To Databricks Staff Software Engineer - Distributed Data Systems

Staff Software Engineer - Network

Staff Software Engineer position at LinkedIn focusing on network infrastructure, distributed systems, and technical leadership, offering $147K-$240K and comprehensive benefits.

Staff Software Engineer - Systems and Infrastructure

Staff Software Engineer position at LinkedIn focusing on systems and infrastructure, building next-generation platforms and distributed systems with competitive pay and benefits.

Staff Software Engineer - Systems Infrastructure

Staff Software Engineer position at LinkedIn focusing on building next-generation infrastructure and platforms, including distributed systems, AI platforms, and open-source projects.

Staff Software Engineer

Staff Software Engineer position at Datadog focusing on building large-scale distributed systems and leading technical initiatives across the organization.

Senior Software Architect - Deep Learning and HPC Communications

Senior Software Architect role at NVIDIA focusing on Deep Learning and HPC Communications, building crucial communication libraries for scaling AI and HPC applications.