Staff Backend Engineer, AI/ML
Description For Staff Backend Engineer, AI/ML
Klue, a rapidly growing VC-backed SaaS company backed by Tiger Global and Salesforce Ventures with a $62M Series B funding, is seeking a Staff Backend Engineer to join their ML Foundation and Platform team in Toronto. This role presents an exciting opportunity to work on cutting-edge LLM applications and ML platform development.
The position focuses on building and optimizing state-of-the-art LLM-powered agents that can reason, plan, and automate workflows for users. As a Staff Engineer, you'll be at the forefront of reinventing insight generation systems, working with both Backend and ML technologies. The role requires expertise in Python, 5+ years of software engineering experience, and deep knowledge of LLMs and retrieval systems.
Key responsibilities include leading the design and implementation of LLM-based agents, creating platforms for ML capability utilization, and deploying ML services to production. You'll work on sophisticated systems processing millions of data points daily, utilizing various ML techniques including classification, clustering, recommendation, and agentic workflows.
Klue offers a competitive compensation package including a salary range of CA$190K – CA$210K, equity options, and comprehensive benefits. The company has received numerous accolades, including being named one of Canada's Most Admired Corporate Cultures and winning the Tech Culture of the Year award.
The work environment is hybrid, requiring at least 2 days per week in the Toronto office. You'll be joining a company that values builders who take ownership, adapt quickly, and balance scientific rigor with practical business impact. The tech stack includes modern tools like OpenAI, PyTorch, Elasticsearch, and various MLOps platforms.
This is an excellent opportunity for a senior technical leader who wants to make a significant impact in the competitive enablement space while working with cutting-edge ML technologies. The role offers both technical challenges and leadership opportunities, making it ideal for someone who wants to shape the future of AI/ML applications in a growing company.
Responsibilities For Staff Backend Engineer, AI/ML
- Lead design and implementation of LLM-based agents
- Create platform for other teams to utilize ML capabilities
- Deploy ML services to production
- Measure and improve retrieval systems
- Develop APIs and scalable systems
- Build machine learning services and data pipelines
- Implement benchmarking systems for prompts
- Build and optimize state-of-the-art LLM-powered agents
- Collaborate cross teams to identify LLM solution needs
- Shape the team's technical roadmap
Requirements For Staff Backend Engineer, AI/ML
- Expertise in Python
- 5+ years of software engineering experience
- Proven experience leading large cross team initiatives
- 3+ years building and optimizing retrieval systems
- Deep understanding of LLMs, retrieval metrics and their trade-offs
- Experience implementing memory and tool-use strategies to enhance LLM-based agent capabilities
- Experience building end-to-end systems as a Platform Engineer, MLOps Engineer, or Data Engineer
- Strong understanding of software testing, benchmarking, and continuous integration
- Knowledge of query augmentation and content enrichment strategies
- Expertise in automated LLM evaluation
- Skilled at prompt engineering
- Track record of staying current with ML research
Benefits For Staff Backend Engineer, AI/ML
- Extended health & dental benefits from day 1
- Employee Stock Option Plan
- Flexible time off (2-4 weeks average)
- Direct access to leadership team
- Hybrid work environment
