Taro Logo

Founding Engineer (Systems/Infrastructure)

Run serverless GPUs on your own cloud
$30,000 - $48,000
DevOps
Staff Software Engineer
In-Person
1 - 10 Employees
2+ years of experience
AI

Description For Founding Engineer (Systems/Infrastructure)

The future of AI is inference

With the rise of agentic workflows and reasoning models, enterprises now need 100x more compute and 10x more throughput to run state-of-the-art AI models. Building robust, scalable inference systems has become a top priority—but it's also a major bottleneck, requiring deep expertise in low-level systems, snapshotters, Kubernetes, and more.

Tensorfuse removes this complexity by helping teams run serverless GPUs in their own AWS account. Just bring:

  1. Your code and env as Dockerfile
  2. Your AWS account with GPU capacity

We handle the rest—deploying, managing, and autoscaling your GPU containers on production-grade infrastructure. Teams use Tensorfuse for:

  • Developer Experience: 10x better than current solutions, helping you move fast and save months of engineering time.
  • Seamless Autoscaling: Spin up 100s of GPUs in real time with startup times as low as 30 seconds (vs. 8–10 mins with custom setups).
  • Security: All workloads run inside your own AWS VPC—your data never leaves your account.
  • Production Features: Native CI/CD integration, custom domain support, volume mounting, and more—out of the box.

As a Founding Engineer focusing on Systems/Infrastructure, you will be at the forefront of building scalable infrastructure for AI inference. You'll be working on challenging technical problems in an emerging market, architecting and implementing backend services, optimizing container startup times, and ensuring high reliability and security of our infrastructure.

The role requires a strong background in Go and Kubernetes, with experience in cloud infrastructure and a methodical approach to debugging complex systems. You'll be joining an early-stage company where your work will have direct impact on shaping the future of AI infrastructure.

This is an in-person role at our Bangalore office, ideal for someone excited about working in a fast-paced startup environment and making significant contributions to the AI infrastructure landscape. The position offers competitive compensation (₹2.5M - ₹4M INR) and equity (0.50% - 0.80%), reflecting the founding nature of the role.

Last updated 21 minutes ago

Responsibilities For Founding Engineer (Systems/Infrastructure)

  • Building scalable infra for AI inference
  • Architecting and implementing backend services in Go and Python
  • Extending Kubernetes operators to optimise them for AI workloads
  • Optimizing container startup times with custom snapshotters written in Go
  • Ensuring high reliability of infrastructure on AWS
  • Ensuring infrastructure level security of AI workloads
  • Designing custom load balancing algorithms for LLMs, video and bio models in production

Requirements For Founding Engineer (Systems/Infrastructure)

Go
Python
Kubernetes
  • 2-3 years of professional experience with Go and/or Kubernetes
  • Familiarity with IaC tools like Cloudformation
  • Methodical in debugging complex systems by diving deeper into code
  • Willing to commit at least two years to the problem
  • Experience with GPU workloads and ML inference (vLLM, SGLang etc) is a plus
  • Experience with working at a startup (between Seed to Series C stage) is a plus

Benefits For Founding Engineer (Systems/Infrastructure)

Equity
  • Equity (0.50% - 0.80%)

Interested in this job?

Jobs Related To Tensorfuse Founding Engineer (Systems/Infrastructure)

Software Lead engineer -Camera Automation and Integration

Lead Software Engineering role at Qualcomm focusing on Camera Automation and Integration, combining DevOps practices with embedded systems expertise in Hyderabad, India.

Staff Software Engineer (Developer Productivity)

Staff Software Engineer position at Okta focusing on developer productivity and infrastructure automation, offering competitive compensation and comprehensive benefits in Toronto.

Software Development Engineer IV DevOps

Senior DevOps Engineer role at Meesho, building scalable infrastructure for India's leading e-commerce platform, requiring 8-12 years of experience in systems engineering.

Lead DevOps Engineer - AI Research Incubation

Lead DevOps Engineer position at Salesforce's AI Research Incubation Team, focusing on cloud infrastructure, CI/CD pipelines, and AI model deployment support.

Staff Operational Technology Engineer

Staff Operational Technology Engineer position at Smith & Nephew, focusing on healthcare technology infrastructure and operations.