Taro Logo

Sr. Staff Software Engineer, AI Infrastructure

LinkedIn is the world's largest professional network, built to help members of all backgrounds and experiences achieve more in their careers.
$180,000 - $300,000
Machine Learning
Staff Software Engineer
Hybrid
5,000+ Employees
8+ years of experience
AI · Enterprise SaaS
This job posting may no longer be active. You may be interested in these related jobs instead:
Sr Staff Engineer, ML Infrastructure and Performance

Senior Staff Engineer position at LinkedIn focusing on ML infrastructure, GPU systems, and high-performance computing. Hybrid role in Mountain View, CA.

Sr. Staff Software Engineer, AI Infrastructure

Senior Staff Software Engineering role at LinkedIn focusing on AI infrastructure, FPGA implementation, and large-scale model optimization with competitive compensation and hybrid work arrangement.

Senior Staff Engineer, Machine Learning - Notifications AI

Senior Staff ML Engineer role at LinkedIn focusing on Notifications AI systems to optimize member experience through advanced machine learning techniques.

Sr Staff Engineer, ML Infrastructure and Performance

Senior Staff Engineer role at LinkedIn focusing on ML infrastructure, GPU computing, and high-performance systems, offering competitive compensation and hybrid work arrangement.

Staff Software Engineer, AI Platform

Staff Software Engineer position at LinkedIn focusing on AI Platform development, involving large-scale machine learning infrastructure and distributed systems.

Description For Sr. Staff Software Engineer, AI Infrastructure

LinkedIn, the world's largest professional network, is seeking a Sr. Staff Software Engineer to join their AI Infrastructure team. This is a unique opportunity to work at the intersection of AI and hardware optimization, focusing on scaling LinkedIn's AI model training and serving capabilities.

The role involves implementing and deploying AI models on FPGA hardware, working with cutting-edge technology to handle models with hundreds of billions of parameters. You'll be responsible for integrating FPGAs with the existing CPU and GPU infrastructure, developing high-performance and power-efficient solutions for large-scale AI models including recommendation systems, large language models, and computer vision applications.

As a Sr. Staff Engineer, you'll lead technical initiatives, mentor team members, and shape the technical culture of the organization. The position requires expertise in hardware design, software development, and AI frameworks, making it ideal for someone who enjoys working across the full stack of AI infrastructure.

The hybrid work environment offers flexibility while maintaining strong team collaboration. You'll work with various teams including AI practitioners, AI Infrastructure, Compute Infrastructure, and Data Center Infrastructure teams, providing opportunities for broad impact and learning.

LinkedIn offers competitive compensation ($180,000 - $300,000) and comprehensive benefits. The company's mission to create economic opportunity for every member of the global workforce provides a meaningful context for your work. If you're passionate about scaling AI systems and have experience with FPGA development, this role offers an exciting chance to shape the future of AI infrastructure at scale.

Last updated 3 days ago

Responsibilities For Sr. Staff Software Engineer, AI Infrastructure

  • Design, implement, and optimize the performance of large-scale AI models on FPGA for personalized recommendation, large language models, and video models
  • Improve the observability and understandability of the FPGA fleet with a focus on improving developer productivity and system sustenance
  • Provide architectural guidance on modern FPGA platforms, tools, and workflows
  • Mentor other engineers, define technical culture, and help build a fast-growing team
  • Function as the tech-lead for key initiatives in AI Infrastructure
  • Implement and deploy AI models on Field Programmable Field Array (FPGA) hardware
  • Integrate FPGAs in current CPU and GPU fleet
  • Develop high-performance and power-efficient FPGA solutions for large scale AI models

Requirements For Sr. Staff Software Engineer, AI Infrastructure

Python
Java
  • BS/BA in Computer Science or related technical field or equivalent technical experience
  • 5+ years of industry experience in hardware design, software design, and algorithm related solutions
  • 5+ years of experience programming in HLS or HDL languages such as C++, SystemC, Verilog, VHDL; and software languages such as Python
  • 5+ years of experience with FPGA development software such as AMD Vitis and Vivado, Intel Quartus
  • 2+ years of experience as an architect, or technical leadership position
  • Hands-on experience developing FPGA hardware solutions and deployment at scale
  • Familiarity with deep learning frameworks and tensor libraries like PyTorch, Tensorflow, JAX/FLAX

Benefits For Sr. Staff Software Engineer, AI Infrastructure

Medical Insurance
Vision Insurance
Dental Insurance
  • Competitive compensation package
  • Hybrid work environment
  • Career growth opportunities

Interested in this job?