Taro Logo

Senior Software Engineer - Inference Backend

AI computing platform providing GPU hardware and cloud-based solutions for AI deployment, founded in 2012 as an AI company built by AI engineers.
$255,000 - $405,000
Backend
Senior Software Engineer
Hybrid
101 - 500 Employees
5+ years of experience
AI

Description For Senior Software Engineer - Inference Backend

Lambda, founded in 2012, is a leading AI computing platform on a mission to become the world's top AI computing infrastructure provider. The Senior Software Engineer - Inference Backend role offers an exciting opportunity to work on cutting-edge AI technology, developing large-scale platforms for running advanced models across thousands of GPUs.

The position involves building high-throughput, low-latency API systems at a geographically-distributed scale, working directly with ML researchers to implement and improve new inference engines across various mediums including text, image, video, and audio. You'll be part of shaping highly reliable distributed systems with a focus on operational efficiency and deep observability.

The ideal candidate brings 5+ years of software engineering experience with large-scale production services and at least 1 year of machine learning experience. Proficiency in Go or Python is essential, along with a product-focused mindset and experience with rapid deployment environments. The role offers competitive compensation ($255,000 - $405,000) and comprehensive benefits including health coverage, 401k matching, and equity.

Lambda's impressive growth trajectory, backed by notable investors including NVIDIA and Gradient Ventures, along with their research contributions to top ML conferences, makes this an excellent opportunity for engineers looking to work at the forefront of AI infrastructure. The hybrid work environment (4 days in San Francisco office) provides a balance of collaborative in-person work while maintaining flexibility.

This role is perfect for someone passionate about AI infrastructure who wants to contribute to building the future of AI computing while working with cutting-edge technology in a fast-paced, growing company.

Last updated a day ago

Responsibilities For Senior Software Engineer - Inference Backend

  • Work on Inference service for developing large-scale platform for running cutting-edge models across GPUs
  • Build high-throughput, low-latency API and routing system at geographically-distributed scale
  • Work with team and ML researchers to adopt and improve new inference engines, models and architectures
  • Shape highly reliable distributed system with focus on reducing operational overhead
  • Help push Lambda forward into the state of the art

Requirements For Senior Software Engineer - Inference Backend

Go
Python
Kubernetes
  • 5 or more years of experience as a software engineer working on large-scale production services
  • 1 year or more of experience working with machine learning (inference experience preferred)
  • Highly skilled at writing Go or Python
  • Product-focused engineer
  • Proven track record of working in rapid deployment environment
  • Willingness to take ownership of projects
  • Experience running and operating production services handling real-time web/internet traffic

Benefits For Senior Software Engineer - Inference Backend

Medical Insurance
Dental Insurance
Vision Insurance
401k
Commuter Benefits
  • Health, dental, and vision coverage for you and your dependents
  • Commuter/Work from home stipends for select roles
  • 401k Plan with 2% company match (USA employees)
  • Flexible Paid Time Off Plan
  • Generous cash & equity compensation

Interested in this job?

Jobs Related To Lambda Senior Software Engineer - Inference Backend

Software Engineer III -Java

Senior Java Software Engineer position at Bank of America, leading development of critical banking applications with 5+ years experience required.

Senior Engineer - Windows Drivers

Senior Windows Driver Engineer role at Qualcomm focusing on development and optimization of Windows drivers, requiring strong knowledge of Windows internals and driver development.

Senior Software Engineer - Qualcomm, Linkoping, Sweden

Senior Software Engineer position at Qualcomm's automotive division in Linkoping, Sweden, focusing on computer vision and autonomous driving systems development.

Linux Kernel Engineer

Senior Linux Kernel Engineer position at Qualcomm focusing on kernel development, virtualization, and system-level software solutions for mobile and IoT platforms.

Senior Linux Video Software Engineer

Senior Linux Video Software Engineer position at Qualcomm focusing on developing and integrating cutting-edge video technology for Linux platforms powered by Qualcomm SoCs.