Sr. Staff Software Engineer, AI Infra

LinkedIn, the world's largest professional network, is seeking a Sr. Staff Software Engineer to join their AI Infrastructure team. This role represents an exceptional opportunity to shape the future of AI platforms at scale, working with cutting-edge technologies and frameworks.

The position focuses on scaling LinkedIn's AI model training, feature engineering, and serving infrastructure handling models with hundreds of billions of parameters. You'll be working with a sophisticated GPU fleet containing thousands of latest GPU cards, optimizing performance across algorithms, AI frameworks, data infrastructure, compute software, and hardware.

The team maintains strong connections with the open source community, with many team members being active committers to projects like TensorFlow, Horovod, Ray, vLLM, Huggingface, and DeepSpeed. You'll be involved in both training and serving infrastructure, working on technologies like LLMs, GNNs, Incremental Learning, and Online Learning.

Key responsibilities include architecting next-generation training infrastructure, implementing high-performance data I/O, enabling distributed training for massive models, and building low-latency serving applications. You'll tackle challenges involving scale (10s of thousands of QPS, multiple terabytes of data), agility (experimenting with hundreds of new ML models), and enabling GPU inference at scale.

The role offers competitive compensation ($180,000 - $300,000), along with annual performance bonuses and equity. LinkedIn provides a comprehensive benefits package and embraces a hybrid work model, combining remote work with in-office collaboration. The company culture strongly emphasizes learning, growth, and making an impact on the global workforce.

This position requires significant technical expertise, with at least 5 years of experience in software development and deep learning systems. The ideal candidate will have strong leadership abilities, experience with distributed systems, and a track record of driving technical innovation. Join LinkedIn to push the boundaries of AI infrastructure and build your career in one of tech's most impactful domains.