Taro Logo

Senior Software Engineer, Core GenAI Platform

Leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit using AI technology.
San Mateo, CA, USAColumbus, OH, USAAustin, TX, USA
$163,600 - $226,400
Backend
Senior Software Engineer
Remote
1,000 - 5,000 Employees
6+ years of experience
AI · Finance

Job Description

Upstart is the leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. By leveraging Upstart's AI marketplace, Upstart-powered banks and credit unions can have higher approval rates and lower loss rates across races, ages, and genders, while simultaneously delivering the exceptional digital-first lending experience their customers demand.

As a Senior Software Engineer on Upstart's Core GenAI Platform team, you will help design and build a unified interface for securely interacting with large language models - abstracting away the complexity of model selection, prompt orchestration, evaluation, and scaling. You'll help build a centralized GenAI layer that enables engineers to use best-in-class LLMs through clean APIs, configurable pipelines, and intuitive tooling.

The team operates with broad scope and high visibility, partnering across Machine Learning, Product, and Compliance to ensure every model integration is performant, secure, and compliant. Whether it's embedding LLMs in user-facing products or optimizing backend workflows, this team makes it seamless for Upstart Engineering to adopt and scale GenAI company-wide.

You'll be working in a digital-first company environment with offices in San Mateo, Columbus, and Austin. The role offers competitive compensation, comprehensive benefits, and the opportunity to work on cutting-edge AI technology that makes a real impact on financial inclusion.

This is an excellent opportunity for an experienced engineer passionate about AI/ML infrastructure who wants to help shape the future of AI-powered financial services while working with modern technologies like Python, Kubernetes, and various LLM frameworks.

Last updated 2 days ago

Responsibilities For Senior Software Engineer, Core GenAI Platform

  • Build the Core GenAI platform powering generative AI use cases across Upstart Engineering
  • Design and implement reliable infrastructure for model inference and prompt orchestration
  • Drive cross-functional adoption of AI tooling
  • Set the technical roadmap for platform capabilities
  • Partner with ML researchers, product engineers, and design teams
  • Ensure platform adheres to security, fairness, and explainability standards

Requirements For Senior Software Engineer, Core GenAI Platform

Python
Kubernetes
Redis
MongoDB
PostgreSQL
  • 6+ years of experience in object-oriented software engineering
  • Proven experience leading cross-functional, multi-quarter projects
  • Proficiency in backend development with Python
  • Hands-on experience building ML platforms or infrastructure supporting LLMs
  • Familiarity with observability tools
  • Strong written and verbal communication skills
  • Strong stakeholder management skills

Benefits For Senior Software Engineer, Core GenAI Platform

401k
Medical Insurance
Dental Insurance
Vision Insurance
Parental Leave
Equity
  • Competitive Compensation (base + bonus & equity)
  • Medical, dental, and vision coverage
  • 401(k) with 100% company match up to $4,500
  • Employee Stock Purchase Plan (ESPP)
  • Life and disability insurance
  • Generous holiday and vacation leave
  • Parental and family care leave
  • Annual wellness and technology reimbursement
  • Catered lunches and snacks in office