Speech AI Engineer
Description For Speech AI Engineer
Vorto is seeking a Speech AI Engineer to lead their voice interface development for their autonomous supply chain platform. This role combines cutting-edge AI technology with practical applications to improve the lives of truck drivers. The position involves building and optimizing speech-to-intent pipelines, developing conversational UX flows, and creating sophisticated personalization features. You'll work with modern technologies like Whisper, GPT-4, and various speech recognition tools to create an intuitive and adaptive voice interface that works reliably in real-world conditions.
The role requires a unique blend of technical expertise in speech recognition, natural language understanding, and machine learning, along with a deep appreciation for human-centered design. You'll be responsible for building systems that evolve from simple command processing to relationship-level tools that can remember, adapt, and provide contextual coaching to drivers.
Vorto's mission focuses on increasing sustainability and efficiency in supply chains while creating more jobs and improving working conditions for approximately 3.5 million truck drivers. The company offers a competitive compensation package ranging from $120K to $500K, plus equity, comprehensive benefits, and a collaborative work environment in their San Francisco office.
The ideal candidate should have experience with voice or AI-driven products, understand the nuances of personalization features, and be passionate about creating technology that respects and elevates working-class users. This is an opportunity to make a significant impact on both the technical and human aspects of supply chain optimization.
Responsibilities For Speech AI Engineer
- Own the Speech interface layer: real-time speech-to-intent pipeline using models like Whisper or Deepgram
- Build conversational UX flows for load search, booking, navigation, and status updates
- Optimize for real-world conditions: noisy cabs, unreliable signal, driver interruptions
- Design fallback logic and graceful failure handling
- Develop personalization features to learn and adapt to each driver's preferences
- Build a driver memory graph to store goals, language patterns, habits, and personality traits
- Implement adaptive prompting based on driver profile tags
- Enable system to reference past conversations and track personal milestones
Requirements For Speech AI Engineer
- Experience building or contributing to voice or AI-driven products with personalization features
- Understanding of relationship-based coaching vs generic commands
- Ability to ship fast while maintaining focus on latency and UX
- Passion for human-first AI design
- Experience with speech recognition technologies (Whisper, Deepgram, Google Speech-to-Text)
- Knowledge of NLU/LLMs (GPT-4, Rasa, LangChain)
Benefits For Speech AI Engineer
- Competitive compensation package
- Health, Dental and Vision Insurance
- 401k with matching
- Company paid life and short-term disability insurance
- Company paid parking or transit pass
- Relocation offered when applicable
- Modern office space
- Daily coffee, tea, drinks & snacks
- Team happy hours
