Taro Logo

Sr Staff Engineer, ML Infrastructure and Performance

LinkedIn is the world's largest professional network, built to create economic opportunity for every member of the global workforce.
$149,000 - $247,000
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS

Description For Sr Staff Engineer, ML Infrastructure and Performance

LinkedIn, the world's largest professional network, is seeking a Senior Staff Engineer to lead their ML infrastructure and performance initiatives. This role represents a unique opportunity to shape the future of AI infrastructure at scale.

The position focuses on designing and maintaining large-scale GPU infrastructure for machine learning and AI workloads. As the technical leader, you'll be responsible for critical decisions regarding hardware selection, architecture design, and ensuring production reliability. The role combines deep technical expertise with strategic leadership, requiring both hands-on engineering skills and the ability to influence cross-functional teams.

Key technical areas include GPU server optimization, high-performance networking (InfiniBand, RoCE, high-speed Ethernet), and scalable storage solutions. You'll work with cutting-edge AI technologies while ensuring operational excellence through monitoring, alerting, and performance optimization.

The ideal candidate brings 8+ years of distributed systems experience, with significant focus on GPU-based ML workloads. Beyond technical skills, you'll need strong communication abilities to work effectively with data scientists, ML engineers, and infrastructure teams.

LinkedIn offers a hybrid work environment, competitive compensation ($149,000-$247,000), and comprehensive benefits. The company's culture emphasizes trust, inclusion, and professional growth, making it an ideal place for senior engineers looking to make a significant impact in the AI infrastructure space.

This role provides the opportunity to influence the direction of ML infrastructure at one of tech's most prominent companies, while working with a talented team on challenging technical problems. You'll be at the forefront of scaling AI capabilities that impact LinkedIn's global professional network.

Last updated 12 hours ago

Responsibilities For Sr Staff Engineer, ML Infrastructure and Performance

  • Define and evaluate GPU server SKUs, memory configurations, and CPU-GPU ratios
  • Design high-throughput, low-latency networking solutions for large-scale distributed training
  • Lead end-to-end operational support for production GPU fleets
  • Develop and maintain observability tooling
  • Partner with Data Scientists, ML Engineers, and DevOps teams
  • Guide junior engineers in architecture best practices
  • Influence the long-term roadmap for ML/AI infrastructure

Requirements For Sr Staff Engineer, ML Infrastructure and Performance

Kubernetes
Linux
  • Bachelor's degree in Computer Science, Electrical Engineering, or related field
  • 8+ years of experience designing and managing large-scale, distributed systems
  • 3+ years focused on GPU-based ML or AI workloads
  • Deep knowledge of high-performance networking
  • Experience with containerization and job schedulers
  • Excellent communication skills
  • Strong organizational skills

Benefits For Sr Staff Engineer, ML Infrastructure and Performance

Medical Insurance
Dental Insurance
Vision Insurance
401k
  • Performance bonus
  • Flexible work arrangements
  • Professional development opportunities
  • Comprehensive benefits package

Interested in this job?

Jobs Related To LinkedIn Sr Staff Engineer, ML Infrastructure and Performance

Sr. Staff Software Engineer, AI Infra

Senior Staff Software Engineer position at LinkedIn focusing on AI infrastructure, distributed systems, and machine learning platforms.

Sr. Staff Software Engineer, AI Infra

Senior Staff Software Engineering role at LinkedIn focusing on AI infrastructure, model training, and distributed systems, offering competitive compensation and hybrid work arrangement.

Staff AI Engineer

Staff AI Engineer position at LinkedIn, focusing on machine learning and AI development, offering $164,000-$268,000 with hybrid work options in multiple locations.

Staff Software Engineer, AI Platform

Staff Software Engineer position at LinkedIn focusing on AI Platform development, requiring expertise in machine learning infrastructure and distributed systems.

Senior Staff AI Engineer, AI Algorithm Foundations

Senior Staff AI Engineer position at LinkedIn focusing on developing next-generation AI systems and LLMs, combining technical leadership with hands-on development.