Taro Logo

Sr. Staff Software Engineer, AI Infra

LinkedIn is the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their careers.
$180,000 - $300,000
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
10+ years of experience
AI · Enterprise SaaS

Description For Sr. Staff Software Engineer, AI Infra

LinkedIn, the world's largest professional network, is seeking a Sr. Staff Software Engineer to join their AI Infrastructure team. This is a hybrid role that combines remote work with in-office collaboration, focusing on pushing the boundaries of scaling large AI models.

The position involves working with cutting-edge AI technologies, including large language models, recommendation systems, and computer vision models. You'll be responsible for scaling LinkedIn's AI model training and feature engineering infrastructure, handling models with hundreds of billions of parameters. The team works with a sophisticated GPU fleet containing thousands of latest GPU cards and collaborates closely with the open source community.

As a Sr. Staff Software Engineer, you'll have the opportunity to work on both Model Training Infrastructure and Model Serving Infrastructure. The training side involves building next-gen infrastructure, implementing high-performance data I/O, and working with popular libraries like Huggingface, Horovod, and PyTorch. The serving side focuses on developing low-latency, high-performance applications for large and complex models, handling challenges like scaling to tens of thousands of QPS and managing multiple terabytes of data.

The role requires a strong technical background with at least 5 years of experience in software development and deep learning systems. You'll be expected to lead technical strategies, mentor other engineers, and contribute to the open-source community. The position offers competitive compensation ($180,000 - $300,000), along with annual performance bonuses and equity.

LinkedIn offers a collaborative environment where you'll work with talented researchers and engineers while building your career in the AI industry. The company values diversity and inclusion, providing equal opportunities for all candidates regardless of background. The hybrid work model allows for flexibility while maintaining strong team connections and culture.

Last updated 3 months ago

Responsibilities For Sr. Staff Software Engineer, AI Infra

  • Owning the technical strategy for broad or complex requirements with insightful and forward-looking approaches
  • Designing, implementing, and optimizing the performance of large-scale distributed serving or training for personalized recommendation and large language models
  • Improving the observability and understandability of various systems
  • Mentoring other engineers and defining technical culture
  • Working closely with the open-source community
  • Functioning as the tech-lead for several concurrent key initiatives AI Infrastructure

Requirements For Sr. Staff Software Engineer, AI Infra

Python
Java
Kubernetes
  • BS/BA in Computer Science or related technical field or equivalent technical experience
  • 5+ years of industry experience in software design, development, and algorithm related solutions
  • 5+ years of experience programming in object-oriented languages such as Python, C++, Java, Go, Rust, Scala
  • 2+ years of experience as an architect, or technical leadership position
  • 5+ years of experience in the industry with leading / building deep learning systems
  • Hands-on experience developing distributed systems or other large-scale systems

Benefits For Sr. Staff Software Engineer, AI Infra

Equity
  • Competitive salary range $180,000 to $300,000
  • Annual performance bonus
  • Stock options
  • Benefits package

Jobs Related To LinkedIn Sr. Staff Software Engineer, AI Infra