Senior Backend Engineer, AI / ML
Description For Senior Backend Engineer, AI / ML
Klue, a rapidly growing SaaS company backed by Tiger Global and Salesforce Ventures with a $62m Series B funding, is seeking a Senior Backend Engineer specializing in AI/ML to join their ML Foundation and Platform team in Toronto. This role focuses on building and optimizing state-of-the-art LLM-powered agents that can reason, plan, and automate workflows for users. The position comes at an exciting time as the company reinvents its insight generation systems.
The role combines deep technical expertise in machine learning, particularly LLMs, with strong backend engineering capabilities. You'll be responsible for developing scalable ML services, implementing sophisticated retrieval systems, and creating platforms that enable other teams to leverage ML capabilities effectively. The work involves everything from prompt engineering to building production-ready ML pipelines and services.
Klue has received numerous accolades, including being named one of Canada's Most Admired Corporate Cultures, winning the Deloitte Technology Fast 50 & Fast 500, and receiving both Startup of the Year and Tech Culture of the Year awards. The company offers a competitive compensation package, including equity options, comprehensive benefits, and flexible PTO.
The ideal candidate brings 5+ years of software engineering experience, with specific expertise in Python and ML technologies. You'll work with cutting-edge tools and technologies, including OpenAI, Anthropic, PyTorch, Elasticsearch, and various MLOps tools. The position offers a hybrid work environment based in Toronto, combining the benefits of remote work with in-office collaboration at least two days per week.
This is an excellent opportunity for someone passionate about practical LLM applications and wants to be at the forefront of competitive enablement technology. The role offers significant autonomy, the chance to shape solutions, and the opportunity to work with an experienced leadership team in a culture that values scientific rigor balanced with pragmatic delivery.
Responsibilities For Senior Backend Engineer, AI / ML
- Lead design and implementation of LLM-based agents
- Create platform for teams to utilize ML capabilities
- Deploy ML services to production
- Measure and improve retrieval systems
- Develop APIs and scalable systems
- Build machine learning services and data pipelines
- Implement benchmarking systems for prompts
- Collaborate cross teams to identify LLM solution needs
- Build and optimize state-of-the-art LLM-powered agents
- Develop scalable tools for ML training and inference
Requirements For Senior Backend Engineer, AI / ML
- Expertise in Python
- 5+ years of software engineering experience
- Proven experience leading large cross team initiatives
- 3+ years building and optimizing retrieval systems
- Deep understanding of LLMs, retrieval metrics and their trade-offs
- Experience implementing memory and tool-use strategies for LLM-based agents
- Experience building end-to-end systems as a Platform Engineer, MLOps Engineer, or Data Engineer
- Strong understanding of software testing, benchmarking, and continuous integration
- Knowledge of query augmentation and content enrichment strategies
- Expertise in automated LLM evaluation
- Skilled at prompt engineering
- Track record of staying current with ML research
Benefits For Senior Backend Engineer, AI / ML
- Extended health & dental benefits from day 1
- Employee Stock Option Plan
- Flexible PTO (2-4 weeks average)
- Direct access to leadership team
- Hybrid work environment
Jobs Related To Klue Senior Backend Engineer, AI / ML
