Taro Logo

Senior Software Engineer, AI/ML

A well-funded startup working on the next generation of work communication tools, focusing on structured and productive team information exchange.
Machine Learning
Senior Software Engineer
In-Person
5+ years of experience
AI · Enterprise SaaS

Description For Senior Software Engineer, AI/ML

Glue, a well-funded startup, is revolutionizing work communication tools by creating more structured and productive solutions. They're seeking a Senior Software Engineer specializing in AI/ML to join their team in San Francisco. The role focuses on building intelligent features using large language models (LLMs) and retrieval-augmented generation (RAG).

The ideal candidate will have extensive experience in both ML systems and production engineering, with at least 5 years of overall experience and 2+ years specifically in LLMs and generative AI. They'll work on everything from prototyping to production deployment, requiring expertise in languages like Python, Go, or TypeScript, and frameworks such as LangChain and LlamaIndex.

This position offers an exciting opportunity to shape the future of work communication, working with cutting-edge AI technology while building practical, user-focused solutions. The role demands someone who can balance technical excellence with practical delivery, understanding both the theoretical aspects of AI/ML and the real-world challenges of production systems.

The company offers competitive compensation including significant equity, comprehensive healthcare benefits, and a flexible vacation policy. They're building an inclusive environment and are committed to equal employment opportunities. This is an ideal role for someone who wants to be part of an early-stage team working on ambitious problems at the intersection of AI and workplace communication.

Last updated 2 months ago

Responsibilities For Senior Software Engineer, AI/ML

  • Work across the stack—from prototyping prompts and pipelines to shipping production systems
  • Play a key role in evaluating model performance and behavior
  • Collaborate across engineering, product, and design to ship experiences
  • Build resilient ML-powered features
  • Handle issues like latency, cost, edge cases, and prompt brittleness

Requirements For Senior Software Engineer, AI/ML

Python
Go
TypeScript
  • 5+ years of engineering experience, ideally including ML, NLP, or applied AI experience
  • 2+ years hands-on with LLMs, transformers, and production-grade generative AI systems
  • 2+ years of experience with a server-side language such as Go, TypeScript, Python, etc.
  • Experience building RAG systems using frameworks like LangChain, LlamaIndex, or custom stacks
  • Experience with multi-modal inputs, fine-tuning open models, or orchestrating agent-style systems
  • Familiarity with evaluation techniques, tooling and quality metrics
  • Independent and self motivated—maintaining side projects or libraries a major plus

Benefits For Senior Software Engineer, AI/ML

Medical Insurance
  • Competitive salary with significant equity
  • Generous healthcare package
  • Equipment provided
  • Flexible vacation policy

Interested in this job?

Jobs Related To Glue Senior Software Engineer, AI/ML