Senior Software Engineer, LLM Platform

Upstart is revolutionizing the lending industry through its AI-powered marketplace, partnering with banks and credit unions to expand access to affordable credit. As a Senior Software Engineer on the LLM Platform team, you'll be at the forefront of implementing generative AI solutions across the company.

The role involves building foundational infrastructure that democratizes access to generative AI for every product and engineering team at Upstart. You'll be responsible for designing and implementing a unified interface for securely interacting with large language models, handling everything from model selection to prompt orchestration and evaluation.

Working under the Senior Director of Engineering, you'll have broad scope and high visibility, collaborating with Machine Learning, Product, and Compliance teams. Your work will ensure that every model integration is performant, secure, and compliant, whether it's embedding LLMs in user-facing products or optimizing backend workflows.

The position offers a competitive compensation package ranging from $163,600 to $226,400 USD, along with comprehensive benefits including medical, dental, and vision coverage, 401(k) matching, equity opportunities, and various wellness programs. As a digital-first company, Upstart provides flexibility with remote work options while maintaining offices in San Mateo, Columbus, and Austin.

The ideal candidate brings 6+ years of software engineering experience, strong systems engineering background, and expertise in backend development and microservices architecture. You should be comfortable with modern infrastructure tools like Kubernetes and Docker, and have hands-on experience with ML platforms or LLM systems.

This is an exciting opportunity to shape the future of AI-driven financial technology while working with cutting-edge LLM technologies. You'll be part of a team that's making significant impacts on both the technical infrastructure and the company's mission of making credit more accessible through technology.