Software Engineer I, AI

About the role

Klue is looking for a hands‑on Software Engineer I to join its AI engineering team in Toronto. You will help build and improve LLM‑powered agent systems that turn massive amounts of competitive data into actionable intelligence for customers.

Key responsibilities

• Ship backend code that powers agent runtimes, scheduled agents, and multi‑agent orchestrators.
• Develop and modify agent services, workflows, and MCP tools.
• Improve retrieval and ranking mechanisms, experimenting with BM25, dense, and hybrid approaches.
• Design and run evaluations to measure agent performance and quality.
• Enhance LLM‑driven workflows by tweaking prompts, adjusting retrieval parameters, adding caching, and reducing latency.
• Write tests, monitor deployments, and address errors to ensure reliability.
• Collaborate closely with senior engineers, product managers, and infrastructure teams.

Required profile

• Production software engineering experience with at least one shipped feature used by customers.
• Strong Python fundamentals and experience with modern Python features.
• Comfortable with async/await, type hints, and code review processes.
• Willingness to learn and deepen knowledge of LLMs, retrieval, and agent infrastructure.

Required skills

• Python
• FastAPI (or similar web framework)
• SQLAlchemy (or another ORM)
• pytest
• Async/await programming
• Type hints

What we offer

• Opportunity to work on cutting‑edge AI products in a fast‑growing company.
• Mentorship from senior engineers and ownership of well‑scoped projects.
• Collaborative environment focused on learning and impact.