Taro Logo

AI Engineer, Product, (Le Chat)

Mistral AI develops high-performance, open-source AI models and solutions, offering enterprise AI platforms and Le Chat assistant.
Machine Learning
Mid-Level Software Engineer
Hybrid
AI

Job Description

Mistral AI is seeking an AI Engineer to join their Product team, specifically working on Le Chat, their AI assistant platform. This role combines machine learning engineering with product development, focusing on building and maintaining LLM evaluation frameworks, metrics tracking, and A/B testing systems. The position offers an opportunity to work with cutting-edge AI technology while ensuring quality, safety, and reliability of AI models.

The ideal candidate will be deeply involved in the technical aspects of LLM deployment, from evaluation frameworks to observability and release management. They'll work directly with the Science team to implement improvements and maintain high standards of model performance. The role requires both technical expertise in Python/TypeScript and practical experience with LLMs, along with strong analytical and communication skills.

Mistral AI offers a flexible hybrid work environment, primarily based in Paris with the option for remote work. The company provides competitive compensation including equity, comprehensive health benefits, and various allowances. They maintain a collaborative, low-ego culture across their international offices in France, USA, UK, Germany, and Singapore.

This position is perfect for someone who wants to be at the forefront of AI development, working with a team that's focused on democratizing AI through high-performance, open-source solutions. The role combines technical challenges with product thinking, requiring someone who can balance engineering excellence with practical product outcomes.

Last updated 8 hours ago

Responsibilities For AI Engineer, Product, (Le Chat)

  • Build and maintain an LLM evaluation framework (reference tests, heuristics, model-graded checks)
  • Define and track metrics: task success, helpfulness, hallucination proxies, safety flags, latency/cost
  • Run A/B tests for prompts, models, and system prompts, analyze results
  • Set up observability for LLM calls: structured logging, tracing, dashboards, alerts
  • Operate the model release process with canary and shadow traffic
  • Improve core behaviors: memory policies, intent classification, tool-call reliability
  • Create templates and documentation for evaluation and safe shipping
  • Partner with Science team and diagnose regressions

Requirements For AI Engineer, Product, (Le Chat)

TypeScript
Python
  • Strong TypeScript or Python skills
  • Production LLM experience with prompts and function calling
  • Experience with evals and A/B testing
  • Knowledge of observability: logging, tracing, dashboards, alerting
  • Product mindset and ability to run experiments
  • Clear written and spoken communication skills

Benefits For AI Engineer, Product, (Le Chat)

Medical Insurance
Visa Sponsorship
Parental Leave
Equity
  • Competitive salary and equity
  • Health insurance
  • Transportation allowance
  • Sport allowance
  • Meal vouchers
  • Private pension plan
  • Generous parental leave policy
  • Visa sponsorship

Related Jobs