Staff Software Engineer, Data Processing Infrastructure

Pinterest is a visual discovery platform where millions of people find inspiration and plan for what matters most in their lives.
$148,049 - $260,000
Data
Staff Software Engineer
Hybrid
1,000 - 5,000 Employees
8+ years of experience

Description For Staff Software Engineer, Data Processing Infrastructure

Pinterest is seeking a Staff Software Engineer for their Data Processing Infrastructure team. This role involves leading the strategy and technical direction of Pinterest's data processing infrastructure for big data and ML/AI applications. The ideal candidate will build and scale data processing frameworks to handle petabytes-scale datasets, work with internal customers on critical business use cases, provide thought leadership on data processing, and contribute to the team's technical vision and long-term roadmap.

Key responsibilities include:

  • Leading data processing infrastructure development for big data and ML/AI
  • Building scalable frameworks for job management, resource management, scheduling, and remote shuffling
  • Collaborating with internal teams on business-critical data processing use cases
  • Guiding company-wide strategies for efficient, reliable, and fast data processing at scale
  • Shaping the team's technical direction and future plans

The role requires:

  • 8+ years of industry experience with a proven track record of technical excellence
  • 5+ years of experience building and supporting large scalable big data platforms
  • Deep knowledge of big data / ML technologies (e.g., Spark, YuniKorn, Celeborn, Flink, Ray, PyTorch/TensorFlow)
  • Experience in leading cross-team engineering efforts
  • Proficiency in programming languages such as Java, Go, Scala, or Python
  • Experience with Kubernetes and AWS technologies

Pinterest offers a flexible work model called PinFlex and is committed to creating an equitable and inclusive workplace. The position is available in Seattle, San Francisco, Palo Alto, or remotely within the US. The salary range for US-based applicants is $148,049 - $260,000 USD, with additional equity compensation available.

Join Pinterest to help millions of users find inspiration and create a life they love while growing your career in a positive corner of the internet.

Last updated 3 months ago

Responsibilities For Staff Software Engineer, Data Processing Infrastructure

  • Lead strategy and technical direction of Pinterest's data processing infrastructure for big data and ML/AI applications
  • Build and scale data processing frameworks to handle petabytes-scale datasets
  • Work with internal customers on critical business use cases
  • Provide thought leadership on data processing efficiency and reliability
  • Contribute to the team's technical vision and long-term roadmap

Requirements For Staff Software Engineer, Data Processing Infrastructure

Java
Go
Scala
Python
Kubernetes
  • 8+ years of industry experience with proven technical excellence
  • 5+ years of experience building and supporting large scalable big data platforms
  • Deep knowledge of big data / ML technologies (e.g. Spark, YuniKorn, Celeborn, Flink, Ray, PyTorch/TensorFlow)
  • Experience in leading cross-team engineering efforts
  • Proficiency in one or more programming languages (Java, Go, Scala, Python)
  • Experience with Kubernetes and AWS technologies

Benefits For Staff Software Engineer, Data Processing Infrastructure

Equity
  • Equity

Interested in this job?

Jobs Related To Pinterest Staff Software Engineer, Data Processing Infrastructure

Visualization Engineer (L5) - Content & Studio

Netflix seeks a Visualization Engineer (L5) for Content & Studio to build data storytelling products and own user experience for internal content reporting.

Staff Product Manager - AI Platform

Staff Product Manager for AI Platform at Intuit, leading development of AI/ML capabilities for model inference, hosting, and serving.

Staff Data Engineer

Join Sojern as a Staff Data Engineer to design and implement scalable data pipelines, working with cutting-edge technologies in the travel marketing industry.

Senior Staff Technical Program Manager, Data

Senior Staff Technical Program Manager, Data at Airbnb: Lead data infrastructure initiatives, collaborate with engineering teams, and drive data-driven decision-making across the company.

Staff Software Engineer, Data Warehouse Compute

Staff Software Engineer position at Airbnb for Data Warehouse Compute, focusing on big data infrastructure and technologies.