Taro Logo

Applied AI Inference Engineer

Baseten provides infrastructure, tooling, and expertise for bringing AI products to market, backed by IVP, Spark Capital, Greylock, and Conviction.
$160,000 - $275,000
Machine Learning
Mid-Level Software Engineer
In-Person
1+ year of experience
AI · Enterprise SaaS

Job Description

Baseten is a well-funded startup that provides essential infrastructure and tooling for bringing AI products to market efficiently. Recently securing a $75M Series C, they're trusted by leading companies like Writer, Abridge, Bland, Patreon, and others for mission-critical AI workloads.

The Applied AI Inference Engineer role is a unique position that combines hands-on engineering with customer-facing responsibilities. As part of the Forward Deployed Engineering Team, you'll work directly with customers to architect, build, and deploy high-scale production AI applications. The role requires strong technical skills in Python and AI/ML systems, along with the ability to translate business requirements into practical solutions.

This position offers an exceptional opportunity for engineers who want to be at the forefront of AI implementation across various industries. You'll be responsible for end-to-end ownership of projects, from initial customer engagement to production deployment, while optimizing for performance, reliability, and cost efficiency.

The ideal candidate should have at least 1 year of professional experience, strong Python skills, and a solid understanding of AI/ML pipelines. The role offers competitive compensation ($160K-$275K) and the chance to work with cutting-edge AI technologies while helping shape the future of AI implementation at scale.

Working at Baseten means joining a diverse, inclusive workplace that values learning and growth. You'll be exposed to various ML startups and their unique challenges, providing unparalleled learning opportunities. The company offers competitive compensation including equity, making it an attractive opportunity for those looking to make a significant impact in the AI infrastructure space.

Last updated 3 days ago

Responsibilities For Applied AI Inference Engineer

  • Develop and maintain software systems using general-purpose programming languages, primarily Python
  • Design, implement, and deploy Baseten solutions end-to-end
  • Work with customer engineering teams throughout the customer journey
  • Transform vague objectives into clear specs and well-defined PoCs
  • Optimize and enhance AI/ML projects
  • Own products and customer projects end-to-end
  • Navigate ambiguity and exercise good judgment on tradeoffs

Requirements For Applied AI Inference Engineer

Python
  • Bachelor's, Master's, or Ph.D. degree in Computer Science, Engineering, Mathematics, or related field
  • 1+ years of professional work experience in a fast-paced, high-growth environment
  • Experience with general-purpose programming languages, preferably Python
  • Familiarity with AI/ML pipelines and model deployment lifecycle
  • Strong communication skills
  • Experience in building or optimizing AI/ML projects

Benefits For Applied AI Inference Engineer

Equity
  • Competitive compensation package
  • Opportunity to be part of a rapidly growing startup
  • Inclusive and supportive work culture
  • Learning and growth opportunities
  • Exposure to various ML startups

Related Jobs

Applied AI Inference Engineer

Applied AI Inference Engineer role at Baseten, working on architecting and deploying high-scale production AI applications with competitive compensation of $160K-$275K.

AI Engineer

AI Engineer position at Shell in Houston, TX, focusing on transforming AI concepts into scalable solutions with competitive salary and comprehensive benefits.

Application Engineer – Computer Vision

Application Engineer position at EchoTwin AI, focusing on developing and optimizing computer vision systems for urban infrastructure intelligence using NVIDIA Jetson platforms.

Machine Learning Engineer

Machine Learning Engineer position at CVS Health focusing on building and deploying AI/ML models with competitive compensation and comprehensive benefits.

Applied AI Engineer

Applied AI Engineer position at Heard, building AI-powered solutions for healthcare businesses, focusing on prototyping and implementing machine learning features in Seattle.