Taro Logo

Software Engineer - AI Infrastructure

Assembled builds infrastructure for customer support, empowering companies with workforce management, BPO collaboration, and AI-powered issue resolution solutions.
$135,000 - $280,000
Cloud
Staff Software Engineer
Hybrid
51 - 100 Employees
6+ years of experience
AI · Enterprise SaaS

Description For Software Engineer - AI Infrastructure

Assembled, backed by $70M in funding, is seeking a Software Engineer for their AI Infrastructure team to build and operate core systems powering their Assist platform. This role focuses on scaling AI infrastructure for their rapidly growing platform that has reached $1M ARR in just 3 months. The position requires 6+ years of engineering experience and expertise in distributed systems and Kubernetes.

The role involves building foundational platform components for real-time LLM usage at scale, working with technologies like AWS, Kubernetes, and various LLM integrations. Key responsibilities include managing agent service reliability, developing prompt and embedding storage systems, implementing security measures, and creating AI-powered developer tools.

This is an ideal opportunity for someone passionate about AI infrastructure who wants to make a significant impact. The position offers comprehensive benefits including medical coverage, unlimited PTO, 401(k), and a hybrid work environment with daily catered lunches in their NY office. The team works cross-functionally with AI, security, and product engineering teams, making it perfect for those who enjoy collaborative, fast-paced environments.

The successful candidate will be instrumental in scaling Assist's infrastructure to meet enterprise customer demands, working with cutting-edge AI technologies, and building systems that enable fast, reliable, and secure AI operations. This high-ownership role offers the chance to shape the infrastructure backbone of Assembled's AI products while working with modern technologies like Go, Python, and various LLM platforms.

Last updated 11 hours ago

Responsibilities For Software Engineer - AI Infrastructure

  • Build and operate core systems powering Assist AI agent platform
  • Manage and scale infrastructure for LLM-powered agents across chat, email, and voice
  • Develop prompt and embedding storage systems
  • Implement privacy and security systems including network-level intrusion detection
  • Operate observability and usage analytics systems
  • Develop AI-powered developer tools for internal engineering workflows

Requirements For Software Engineer - AI Infrastructure

Go
Python
Kubernetes
PostgreSQL
Redis
  • 6+ years of engineering experience, with past ownership of high-scale, production-critical infrastructure
  • Experience with distributed systems and container orchestration (especially Kubernetes)
  • Experience with AI/ML platforms or excitement to build foundational infrastructure for LLM-based applications
  • Strong familiarity with AWS, Kubernetes, LLM integration, vector databases, Postgres, Redis, Go, Python
  • Thrive in fast-paced environments with shifting requirements
  • Motivated by impact and enjoy deep technical challenges

Benefits For Software Engineer - AI Infrastructure

Medical Insurance
Dental Insurance
Vision Insurance
401k
Parental Leave
Commuter Benefits
  • Generous medical, dental, and vision benefits
  • Paid company holidays, sick time, and unlimited time off
  • Monthly credits for professional development, wellness, and commuting
  • Paid parental leave
  • Hybrid work model with catered lunches everyday (M-F)
  • 401(k) plan enrollment

Interested in this job?

Jobs Related To Assembled Software Engineer - AI Infrastructure