Distinguished Engineer, Apache Spark

NVIDIA is seeking a Distinguished Engineer for their Apache Spark Acceleration group, focusing on GPU-accelerated data processing. This role sits at the intersection of distributed systems and GPU computing, working to optimize Apache Spark - the most popular data processing engine in data centers. Over the past five years, GPU accelerated data processing has evolved from concept to production, with NVIDIA's open source RAPIDS Spark library now integrated with major cloud services including AWS EMR, Databricks, and Google Dataproc.

As a Distinguished Engineer, you'll serve as a hands-on architect working with a team of distributed system engineers, including PMC and Committers of various Apache projects. You'll be deeply involved in open source communities, contributing to projects like Apache Spark, RAPIDS, Apache Iceberg, and Delta Lake. The role requires extensive experience in distributed systems, with opportunities to influence the architecture of next-generation data processing solutions.

The position offers a competitive compensation package with a base salary range of $308,000 - $471,500 USD, plus equity and benefits. You'll be working at NVIDIA, the world leader in accelerated computing, contributing to solutions that tackle unprecedented challenges in AI and digital twins, transforming major industries.

The ideal candidate brings 17+ years of software development experience, deep expertise in distributed systems, and a strong track record of open source contributions. You'll need excellent programming skills in C++, Java, and/or Scala, along with comprehensive knowledge of distributed system schedulers. This role offers the opportunity to shape the future of big data processing while working with cutting-edge GPU technology.