Taro Logo

Sr. Staff Software Engineer, AI Infra

LinkedIn is the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their careers.
$180,000 - $300,000
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
10+ years of experience
AI · Enterprise SaaS

Description For Sr. Staff Software Engineer, AI Infra

LinkedIn, the world's largest professional network, is seeking a Sr. Staff Software Engineer to join their AI Infrastructure team. This is a hybrid role that combines remote work with in-office collaboration, focusing on pushing the boundaries of scaling large AI models.

The position involves working with cutting-edge AI technologies, including large language models, recommendation systems, and computer vision models. You'll be responsible for scaling LinkedIn's AI model training and feature engineering infrastructure, handling models with hundreds of billions of parameters. The team works with a sophisticated GPU fleet containing thousands of latest GPU cards and collaborates closely with the open source community.

As a Sr. Staff Software Engineer, you'll have the opportunity to work on both Model Training Infrastructure and Model Serving Infrastructure. The training side involves building next-gen infrastructure, implementing high-performance data I/O, and working with popular libraries like Huggingface, Horovod, and PyTorch. The serving side focuses on developing low-latency, high-performance applications for large and complex models, handling challenges like scaling to tens of thousands of QPS and managing multiple terabytes of data.

The role requires a strong technical background with at least 5 years of experience in software development and deep learning systems. You'll be expected to lead technical strategies, mentor other engineers, and contribute to the open-source community. The position offers competitive compensation ($180,000 - $300,000), along with annual performance bonuses and equity.

LinkedIn offers a collaborative environment where you'll work with talented researchers and engineers while building your career in the AI industry. The company values diversity and inclusion, providing equal opportunities for all candidates regardless of background. The hybrid work model allows for flexibility while maintaining strong team connections and culture.

Last updated a day ago

Responsibilities For Sr. Staff Software Engineer, AI Infra

  • Owning the technical strategy for broad or complex requirements with insightful and forward-looking approaches
  • Designing, implementing, and optimizing the performance of large-scale distributed serving or training for personalized recommendation and large language models
  • Improving the observability and understandability of various systems
  • Mentoring other engineers and defining technical culture
  • Working closely with the open-source community
  • Functioning as the tech-lead for several concurrent key initiatives AI Infrastructure

Requirements For Sr. Staff Software Engineer, AI Infra

Python
Java
Kubernetes
  • BS/BA in Computer Science or related technical field or equivalent technical experience
  • 5+ years of industry experience in software design, development, and algorithm related solutions
  • 5+ years of experience programming in object-oriented languages such as Python, C++, Java, Go, Rust, Scala
  • 2+ years of experience as an architect, or technical leadership position
  • 5+ years of experience in the industry with leading / building deep learning systems
  • Hands-on experience developing distributed systems or other large-scale systems

Benefits For Sr. Staff Software Engineer, AI Infra

Equity
  • Competitive salary range $180,000 to $300,000
  • Annual performance bonus
  • Stock options
  • Benefits package

Interested in this job?

Jobs Related To LinkedIn Sr. Staff Software Engineer, AI Infra

Senior Staff Engineer, Machine Learning - Notifications AI

Senior Staff Engineer position at LinkedIn leading the Notifications AI team, focusing on machine learning and personalization systems with competitive compensation $191K-$315K.

Sr Staff Engineer, ML Infrastructure and Performance

Senior Staff Engineer role at LinkedIn focusing on ML infrastructure, GPU computing, and performance optimization. Hybrid role in Sunnyvale, CA with competitive compensation.

Senior Staff AI Engineer, AI Algorithm Foundations

Senior Staff AI Engineer position at LinkedIn focusing on developing next-generation AI algorithms and foundational models for professional networking platform serving over billion members.

Senior Staff Engineer, Machine Learning - Notifications AI

Senior Staff Engineer position at LinkedIn focusing on Machine Learning and AI for notifications systems, offering competitive compensation and the opportunity to work with cutting-edge AI technologies.

Staff Software Engineer, AI Platform

Staff Software Engineer position at LinkedIn focusing on AI Platform development, including model training infrastructure and feature engineering.