Senior AI/ML Engineer

AI co-pilot for sales reps at industrial wholesale distributors, helping with quoting and margin optimization.
$150,000 - $200,000
Machine Learning
Senior Software Engineer
Hybrid
11 - 50 Employees
6+ years of experience
AI · Enterprise SaaS

Description For Senior AI/ML Engineer

Distro is revolutionizing the industrial distribution sector with an AI-powered sales platform. As a Senior AI/ML Engineer, you'll own the entire AI infrastructure, working directly with foundation models to build and deploy core features.

The role involves creating sophisticated systems for document retrieval, product spec extraction, quote generation, and semantic search. You'll be responsible for everything from prompt engineering to vector search implementation and model serving, ensuring high performance and reliability in customer-facing applications.

We're looking for someone with strong engineering fundamentals and hands-on LLM experience. You should be comfortable with agentic chat frameworks, vector databases, and model deployment. The ideal candidate has shipped AI features to real users and can work autonomously in ambiguous situations.

The position is hybrid (4 days in-office) in Palo Alto, offering competitive compensation ($150K–$200K + 0.50%–0.75% equity). You'll join at a crucial moment - post-Seed, with real customers and revenue, in a $7T global market ripe for transformation.

What sets us apart:

  • Building real AI solutions for real-world problems
  • Focus on shipping and iterating based on user feedback
  • Strong emphasis on in-person collaboration and rapid development
  • Design-forward approach with excellent engineering talent
  • Massive market opportunity in industrial distribution

Required skills include experience with:

  • LangGraph, LangChain, or LlamaIndex
  • Vector databases (MongoDB Vector Store, Pinecone, Weaviate)
  • AWS Sagemaker or similar for model deployment
  • Production-quality Python and/or TypeScript

The role offers a unique opportunity to shape the future of industrial distribution while working with cutting-edge AI technology in a fast-paced, product-focused environment. Join us in building AI solutions that make a real impact in a traditionally underserved market.

Last updated 9 hours ago

Responsibilities For Senior AI/ML Engineer

  • Build and ship AI-powered features using foundation models
  • Own the AI stack — from prompt engineering to vector search to model serving
  • Implement RAG pipelines, chat agent workflows, and quoting/document workflows
  • Optimize for performance and latency in customer-facing UX
  • Work closely with the CEO to transition ownership of AI/ML work
  • Evaluate, test, and iterate on LLMs, prompts, and product experiences
  • Set technical direction for productionizing and scaling AI infrastructure

Requirements For Senior AI/ML Engineer

Python
TypeScript
  • Strong engineering fundamentals and hands-on experience building with LLMs
  • Experience with foundation models, prompt design, embeddings, and vector DBs
  • Experience shipping AI features to real users
  • Comfort owning the stack end-to-end, including deployment and monitoring
  • Must be in-person 4 days per week in Palo Alto
  • Experience with agentic chat + retrieval frameworks
  • Experience with vector databases
  • Model deployment + fine-tuning experience
  • Expertise in production quality Python and/or TypeScript
  • 6+ years of experience

Interested in this job?

Jobs Related To Distro Senior AI/ML Engineer

Senior Software Engineer

Senior Software Engineer role at Microsoft's AI Frameworks team, focusing on optimizing AI model performance and working with OpenAI on Azure services.

Software Engineer, Systems ML - SW/HW Co-design

Senior AI Software Engineer role at Meta focusing on ML systems optimization and hardware acceleration, combining advanced AI infrastructure expertise with technical leadership responsibilities.

Founding AI Engineer

Founding AI Engineer position at Firecrawl, building cutting-edge AI infrastructure for web data extraction

Machine Learning Engineer, Forecast Platform

Senior Machine Learning Engineer position at DoorDash, focusing on developing forecasting models and ML systems to optimize their three-sided marketplace operations.

Senior Software Engineer, AI/ML GenAI, Google Cloud AI

Senior Software Engineer position at Google Cloud AI focusing on GenAI development and implementation, offering competitive compensation and the opportunity to work on cutting-edge AI technologies.