Taro Logo

Staff Software Engineer, Batch Processing Platform

A platform where millions of people find creative ideas and inspiration to create a life they love.
$170,371 - $350,763
Staff Software Engineer
Hybrid
5,000+ Employees
8+ years of experience
Enterprise SaaS

Description For Staff Software Engineer, Batch Processing Platform

Pinterest is seeking a Staff Software Engineer to lead their Batch Processing Platform team, working with cutting-edge big data technologies at a massive scale. This role combines technical leadership with hands-on engineering, focusing on building and scaling Pinterest's next-generation batch processing infrastructure that handles hundreds of petabytes of data. The position offers an opportunity to work with and contribute to open-source technologies like Spark, Kafka, and Kubernetes while directly impacting millions of users' experience. The ideal candidate will bring extensive experience in big data systems, demonstrated leadership in cross-team initiatives, and a track record of open-source contributions. This hybrid role offers flexibility with quarterly in-person collaboration requirements, competitive compensation including equity, and the chance to work at a company that helps millions find inspiration. The position requires deep technical expertise combined with strategic thinking to shape the future of data processing at Pinterest.

Last updated 2 days ago

Responsibilities For Staff Software Engineer, Batch Processing Platform

  • Lead the strategy and technical direction of Pinterest's Spark platform
  • Improve and customize the internals of open source Spark
  • Build and scale batch processing frameworks and infrastructure to process petabytes-scale datasets
  • Work with internal customers on critical business use cases
  • Provide thought leadership on data processing and storage
  • Contribute to the team's technical vision and long-term roadmap

Requirements For Staff Software Engineer, Batch Processing Platform

Java
Python
Kafka
Kubernetes
  • 8+ years of industry experience with proven track record of technical excellence
  • 5+ years of experience building and supporting large scalable big data infrastructure/platform
  • 2+ years of experiences in contributing to open-source Spark
  • Deep knowledge of big data technologies (Spark, Hadoop, Parquet/ORC, Flink)
  • Experience in leading cross-team engineering efforts
  • Proficiency in one or more programming languages (Java, Scala, Python)
  • Experiences in Kubernetes and AWS technologies
  • BS degree in Computer Science or equivalent experience

Benefits For Staff Software Engineer, Batch Processing Platform

Medical Insurance
Equity
  • Equity compensation
  • Competitive salary range
  • Flexible working model (PinFlex)
  • In-office collaboration 1-2 times/quarter

Interested in this job?

Jobs Related To Pinterest Staff Software Engineer, Batch Processing Platform