Taro Logo

Sr. Staff Software Engineer, AI Infra

LinkedIn is the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their careers.
$180,000 - $300,000
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
10+ years of experience
AI · Enterprise SaaS

Description For Sr. Staff Software Engineer, AI Infra

LinkedIn, the world's largest professional network, is seeking a Sr. Staff Software Engineer to join their AI Infrastructure team. This role presents an exciting opportunity to push the boundaries of scaling large models and shape the future of AI platforms at LinkedIn.

The position focuses on scaling LinkedIn's AI model training, feature engineering, and serving infrastructure handling models with hundreds of billions of parameters. You'll work with cutting-edge technology, optimizing performance across algorithms, AI frameworks, data infrastructure, and hardware to manage thousands of latest GPU cards.

As a technical leader, you'll collaborate with open source communities, working with popular frameworks like TensorFlow, Horovod, Ray, vLLM, and Huggingface. The role involves building next-generation training infrastructure, enabling distributed training for massive models, and developing high-performance serving systems for both LLM and personalization models.

The ideal candidate brings deep expertise in distributed systems, machine learning infrastructure, and technical leadership. You'll tackle challenges at unprecedented scale, handling tens of thousands of QPS, multiple terabytes of data, and billions of model parameters. This role offers the unique opportunity to advance one of the world's most scalable AI platforms while building your career and personal brand in the AI industry.

Working at LinkedIn means joining a culture focused on trust and flexibility, with a hybrid work model that balances remote work with in-office collaboration. The company's vision of creating economic opportunity for every member of the global workforce drives their investment in talent and support for career growth.

This role offers competitive compensation, including a salary range of $180,000 to $300,000, plus annual performance bonus, stock options, and comprehensive benefits. Join LinkedIn to challenge yourself with work that matters while helping shape the future of AI infrastructure at scale.

Last updated 3 months ago

Responsibilities For Sr. Staff Software Engineer, AI Infra

  • Own technical strategy for broad or complex requirements with forward-looking approaches
  • Design and implement large-scale distributed serving and training for personalized recommendation and language models
  • Improve system observability and developer productivity
  • Mentor other engineers and define technical culture
  • Work with open-source community and influence cutting-edge projects
  • Function as tech-lead for key AI Infrastructure initiatives

Requirements For Sr. Staff Software Engineer, AI Infra

Python
Java
Go
Rust
Scala
Kubernetes
  • BS/BA in Computer Science or related technical field or equivalent experience
  • 5+ years of industry experience in software design and algorithm solutions
  • 5+ years of experience in object-oriented languages (Python, C++, Java, Go, Rust, Scala)
  • 2+ years of experience as an architect or technical leadership position
  • 5+ years of experience building deep learning systems
  • Hands-on experience developing distributed systems
  • MS or PhD in Computer Science preferred
  • Experience with ML applications, LLM serving, GPU serving preferred
  • Expertise in machine learning infrastructure (MLFlow, Kubeflow)
  • Experience with deep learning frameworks (PyTorch, Tensorflow, JAX/FLAX)

Benefits For Sr. Staff Software Engineer, AI Infra

Medical Insurance
401k
Parental Leave
  • Competitive salary range $180,000 to $300,000
  • Annual performance bonus
  • Stock options
  • Comprehensive benefits package

Jobs Related To LinkedIn Sr. Staff Software Engineer, AI Infra