Taro Logo

Senior Software Engineer, AI

Building the world's first clinically validated, physician-supervised conversational agent that manages chronic diseases.
$150,000 - $250,000
Machine Learning
Senior Software Engineer
Remote
5+ years of experience
AI · Healthcare
This job posting may no longer be active. You may be interested in these related jobs instead:
AIML - Software Engineer, Machine Learning Platform & Infrastructure

Senior Software Engineer role at Apple focusing on machine learning infrastructure and platform development, offering competitive pay and benefits in Seattle.

Software QA Engineer, Machine Learning

Senior Software QA Engineer role at Apple focusing on machine learning quality assurance for iOS and macOS creativity applications.

Senior Machine Learning Engineer, Bedrock

Senior Machine Learning Engineer position at Amazon's AWS Bedrock team, focusing on GenAI model optimization and inference efficiency.

Senior Machine Learning Engineer, Bedrock

Senior Machine Learning Engineer position at Amazon's Bedrock team, focusing on developing and optimizing GenAI models and inference engines.

Senior Software Development Engineer - GenAI, Amazon Ads - Creative X

Senior Software Engineering role at Amazon Ads focusing on developing AI-based systems for creative content optimization and advertising technology.

Description For Senior Software Engineer, AI

UpDoc is at the forefront of revolutionizing healthcare through AI technology, building the world's first clinically validated, physician-supervised conversational agent for managing chronic diseases. Working alongside prestigious partners including Stanford, Mayo Clinic, Eli Lilly, UCSF Health, and Microsoft, we're creating a future where high-quality healthcare is universally accessible.

We're seeking a Senior Software Engineer with strong AI/ML expertise to lead our patient-facing conversational agent development. This role combines cutting-edge LLM technology with practical healthcare applications, requiring both technical excellence and an understanding of healthcare standards.

The ideal candidate brings 5+ years of software development experience, with particular strength in backend development and LLM applications. You'll be working with modern Python, FastAPI, and state-of-the-art LLM technologies, implementing scalable solutions for voice and multimodal conversations. Your responsibilities will span from prompt engineering to MLOps, requiring both technical depth and breadth.

This is an exceptional opportunity for someone passionate about AI's potential in healthcare. You'll be joining a small, high-impact team where your work directly influences the future of healthcare delivery. The role offers competitive compensation, including equity in an early-stage startup, and the chance to work with world-class medical institutions.

As a remote position, we offer flexibility while maintaining close collaboration with our team and clinical experts. You'll be instrumental in developing and validating AI systems that must meet the highest standards of medical accuracy and reliability. If you're excited about using AI to solve meaningful healthcare challenges and want to be at the forefront of medical AI innovation, this role offers the perfect blend of technical challenge and social impact.

Last updated 4 months ago

Responsibilities For Senior Software Engineer, AI

  • Lead the development of patient-facing conversational agent
  • Implement scalable, low-latency system for voice/multimodal conversations
  • Implement rigorous prompt engineering processes and develop system evaluation metrics
  • Create data pipelines for fine-tuning and alignment experimentation
  • Work with backend engineers to deploy AI models and chat/voice APIs
  • Evaluate and implement emerging LLM technologies
  • Collaborate with clinical experts for validation
  • Develop backend services using FastAPI and Pydantic

Requirements For Senior Software Engineer, AI

Python
  • 5+ years of professional software development experience
  • 2+ years of backend web development experience
  • 2+ years of experience building end-to-end LLM applications
  • Experience with type-hinted, modern Python
  • Experience integrating/optimizing LLMs in production environments
  • Knowledge of evaluation frameworks
  • Experience with MLOps/LLMOps best practices
  • Experience building AI infrastructure from 0 to 1
  • Experience with cloud platforms (especially Azure) and containerization technologies

Benefits For Senior Software Engineer, AI

Equity
  • Competitive compensation
  • Equity in an early-stage startup
  • Work with cutting-edge LLM tools
  • Opportunity to shape core technical architecture
  • Work with world-class medical institutions

Interested in this job?