Taro Logo

Data Engineer, Personalization

World's most popular audio streaming subscription service, launched in 2008, focusing on music and podcasting.
$160,091 - $228,702
Data
Mid-Level Software Engineer
Remote
5,000+ Employees
3+ years of experience
AI · Enterprise SaaS

Description For Data Engineer, Personalization

Spotify, the world's leading audio streaming platform, is seeking a Data Engineer to join their Personalization's Hulk squad. This team is at the forefront of developing Human Understandable Language Knowledge using Large Language Models to enhance podcast and audiobook understanding. The role offers a unique opportunity to impact millions of listeners' experiences through sophisticated recommendation systems.

The position combines data engineering with machine learning, requiring expertise in building scalable data pipelines and working with cutting-edge LLM technologies. You'll be part of a cross-functional team that includes ML Engineers, Backend Engineers, and researchers, focusing on developing and maintaining robust data systems that power Spotify's content understanding capabilities.

Key responsibilities include managing large-scale data pipelines, supporting LLM model inference, developing training datasets, and creating monitoring tools for AI product quality. The role offers competitive compensation ($160,091-$228,702 plus equity) and comprehensive benefits including health insurance, parental leave, and flexible work arrangements.

The ideal candidate should be passionate about data engineering, experienced with high-scale production pipelines, and have a strong interest in machine learning technologies. You'll work in an agile environment that values experimentation, iteration, and knowledge sharing. This position offers the flexibility to work remotely within North America, with collaboration centered in the Eastern Standard time zone.

Join Spotify's inclusive workplace culture where diversity is celebrated and innovation is constant. You'll be part of a company that has revolutionized the music industry and continues to push boundaries in audio streaming technology.

Last updated a day ago

Responsibilities For Data Engineer, Personalization

  • Work with large-scale data pipelines using data processing frameworks
  • Support streaming and batch inference of core LLM models
  • Develop new data pipelines to meet emerging needs
  • Work with ML engineers to develop training and evaluation datasets
  • Own the development of data solutions from architecture to delivery
  • Collaborate with other backend and data engineers, ML engineers, and stakeholders
  • Develop monitoring tools to automatically track AI product quality
  • Work in an agile team to continuously experiment, iterate and deliver
  • Share knowledge and promote standard methodologies

Requirements For Data Engineer, Personalization

Python
  • Proficient in data modeling, data access, and data storage optimization
  • Experience building high-scale production data pipelines
  • Knowledge of data processing frameworks like Scio (Apache Beam)
  • Experience with orchestration frameworks such as Flyte (preferred)
  • Understanding of agile software processes
  • Strong collaboration and partnership skills
  • Experience with ML Data processing and inference pipelines
  • Experience with NRT systems (bonus)
  • Experience with prompt engineering for LLMs (bonus)

Benefits For Data Engineer, Personalization

401k
Medical Insurance
Parental Leave
  • Health insurance
  • Six month paid parental leave
  • 401(k) retirement plan
  • Monthly meal allowance
  • 23 paid days off
  • 13 paid flexible holidays
  • Paid sick leave

Interested in this job?

Jobs Related To Spotify Data Engineer, Personalization