Taro Logo

Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

World's leading entertainment service with 283 million paid memberships in over 190 countries offering TV series, films and games.
United States
$100,000 - $720,000
Machine Learning
Senior Software Engineer
Remote
5,000+ Employees
5+ years of experience
AI · Enterprise SaaS · Entertainment

Description For Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Netflix, the world's leading entertainment service, is seeking a Senior Software Engineer for their Model Serving Systems team within the Machine Learning Platform. This role is crucial in building and maintaining the computational platform that powers Netflix's ML/AI applications, including their cutting-edge work with Large Language Models (LLMs). The position offers an opportunity to work on highly scalable systems that directly impact Netflix's 283 million subscribers across 190 countries.

The role involves developing infrastructure for serving ML models at scale, including real-time model inference platforms and foundational abstractions ensuring consistency between online and offline systems. You'll be working with state-of-the-art technology in personalization, search, and recommendation systems, while helping to expand their model serving capabilities to meet evolving AI needs.

As a senior engineer, you'll collaborate with a diverse team of engineers, product managers, and data scientists, working on business-critical models that directly influence the customer experience. The position requires expertise in distributed systems, ML model serving, and strong programming skills, particularly in Java. You'll be responsible for performance tuning, deployment management, and capacity planning for large-scale ML systems.

The compensation is highly competitive, ranging from $100,000 to $720,000, with the flexibility to choose your mix of salary and stock options. Netflix offers comprehensive benefits including health plans, mental health support, and generous time off policies. This remote position provides an excellent opportunity to work with cutting-edge AI technology while maintaining work-life balance.

Last updated 8 minutes ago

Responsibilities For Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

  • Develop and expand compute infrastructure to support growing AI needs
  • Enable ML application in new business areas
  • Drive ML/AI innovation across Netflix
  • Build scalable model-serving solutions for generative models and LLMs
  • Partner with engineers, product managers, ML engineers, and data scientists
  • Maintain and optimize high-availability ML model serving systems

Requirements For Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Java
  • BS/MS in Computer Science, Applied Math, Engineering, or related field
  • Experience building high-traffic distributed services for ML model inference
  • Proficiency in object-oriented programming (preferably Java)
  • Experience with ML model deployment using tools like Triton Inference Server, TensorRT, Docker
  • Experience working with public cloud (AWS, Azure, or GCP)
  • Strong communication skills with focus on observability and logging

Benefits For Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Medical Insurance
Mental Health Assistance
401k
Vision Insurance
Dental Insurance
Parental Leave
  • Health Plans
  • Mental Health support
  • 401(k) Retirement Plan with employer match
  • Stock Option Program
  • Disability Programs
  • Health Savings and Flexible Spending Accounts
  • Family-forming benefits
  • Life and Serious Injury Benefits
  • 35 days annual PTO for hourly employees
  • Flexible time off for salaried employees

Interested in this job?

Jobs Related To Netflix Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Software Engineer L4/L5, Model Serving Systems, Machine Learning Platform

Senior Software Engineer position at Netflix focusing on building and scaling ML/AI infrastructure for model serving systems, with emphasis on LLMs and foundation models.

ML Compiler Engineer, AWS Neuron, Annapurna Labs

ML Compiler Engineer position at AWS Neuron team, focusing on optimizing deep learning and GenAI workloads for custom ML accelerators through kernel development and compiler optimization.

Software Senior Engineer - AI Engineering

Senior Software Engineer position at Dell Technologies focusing on AI Engineering, developing cutting-edge AI applications and solutions within the Office of the CTO Dojo team.

AI ADK Software Engineer

Senior AI software engineering role focusing on embedded deep learning and neural network optimization for automotive applications at Qualcomm China.

Senior Software Engineer, Sous Chef

Senior Software Engineer position at Toast, focusing on AI/ML solutions for restaurant management, offering $130K-$210K salary, hybrid work, and comprehensive benefits.