Taro Logo

Staff Software Engineer, ML Serving Platform

A platform where millions of people find creative ideas and inspiration to create a life they love.
$170,371 - $350,763
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Staff Software Engineer, ML Serving Platform

Pinterest is seeking a Staff Software Engineer to join their ML Serving team within the ML Platform organization. This role is crucial in developing and maintaining the ML inference engine that powers Pinterest's various ML applications across recommendations, ads, visual search, and trust and safety.

The position offers an opportunity to work at the intersection of machine learning and large-scale distributed systems. As part of the ML Platform team in Data Engineering, you'll be responsible for ensuring the efficiency and reliability of ML workloads across 40+ use cases at Pinterest. The role involves working with cutting-edge ML technologies, including GPU acceleration and optimization techniques.

The ideal candidate will bring deep expertise in ML systems, particularly in inference optimization and production deployment. You'll be working with modern ML frameworks like PyTorch, TensorRT, and vLLM, while applying advanced optimization techniques to improve system performance. The role requires both technical depth in ML systems and the ability to collaborate effectively with teams across the organization.

Pinterest offers a flexible working model, requiring in-person collaboration only 1-2 times per quarter, making this position accessible to candidates across the country. The company provides competitive compensation, including a base salary range of $170,371-$350,763 USD, plus equity opportunities. Pinterest is committed to creating an inclusive workplace and considers candidates regardless of background, fostering a diverse and equitable environment.

This role presents an exciting opportunity to impact millions of users while working with cutting-edge ML technologies at scale. You'll be part of a team that's essential to Pinterest's core functionality, helping to power the discovery and recommendation systems that make Pinterest a unique platform for inspiration and creativity.

Last updated 12 hours ago

Responsibilities For Staff Software Engineer, ML Serving Platform

  • Architect and develop large-scale ML inference engines and serving systems using GPUs and hardware accelerators
  • Create and implement strategic roadmaps for ML inference technologies
  • Collaborate with cross-functional teams on innovative ML projects
  • Work with ML engineers to understand requirements and create solutions
  • Provide technical mentorship to junior engineers

Requirements For Staff Software Engineer, ML Serving Platform

Python
Kubernetes
  • Comprehensive understanding of production-scale ML systems
  • Experience building large-scale ML systems in production
  • Knowledge of ML frameworks including PyTorch, TensorRT, and vLLM
  • Expertise in GPU programming and optimization techniques
  • Strong programming skills in Python and C++
  • Bachelor's degree in Computer Science, Engineering, or related field
  • Understanding of distributed systems principles

Benefits For Staff Software Engineer, ML Serving Platform

Medical Insurance
Equity
  • Flexible working model with hybrid options
  • Equity compensation
  • Comprehensive benefits package

Interested in this job?

Jobs Related To Pinterest Staff Software Engineer, ML Serving Platform