📢 New: get today's jobs on our WhatsApp Channel
Jobiglo

No results.

AI Engineer (Large Language Models & RAG)

bdo · Toronto - Bay St

New
Senior 77,000 - 117,000 CAD/year 🇬🇧 English
Python LangChain LlamaIndex AutoGPT OpenAI API Anthropic Hugging Face LangGraph Pinecone Milvus Weaviate Azure AI AWS Bedrock Google Cloud Platform Docker Kubernetes CI/CD MLflow Weights & Biases SQL NoSQL

Job description

About the role

BDO is hiring an experienced AI Engineer in Toronto to design, build and deploy production-grade AI solutions that bridge experimental machine learning with scalable software engineering. The role focuses on large language models (LLMs), retrieval-augmented generation (RAG) and agentic workflows, within established governance frameworks.

Key responsibilities

  • Design, build and deploy scalable AI applications using LangChain, LlamaIndex, AutoGPT and related LLM orchestration tools.
  • Develop, refine and optimize prompts, manage model context windows and fine-tune models where needed.
  • Integrate AI into enterprise environments via RESTful APIs, microservices and cloud-native architectures.
  • Maintain vector databases (Pinecone, Milvus, Weaviate) and build data ingestion and embedding pipelines for RAG.
  • Monitor production systems and address hallucinations, latency, reliability, scalability and token-cost issues.
  • Collaborate with AI Architects, ML Engineers, Data Scientists, developers and citizen developers on firm-wide initiatives.
  • Support documentation, lifecycle management and control processes aligned with ISO/IEC 42001, and adhere to AI risk, data governance and security policies.
  • Take part in model testing and validation under the NIST AI Risk Management Framework.

Required profile

  • Bachelor's or Master's degree in Computer Science, Engineering or a related field.
  • 3-5 years of professional experience in AI, machine learning or applied software engineering.
  • Expert-level Python, with working familiarity in Java and/or TypeScript.
  • Hands-on experience with OpenAI APIs, Anthropic, Hugging Face, LangGraph and LLM-based application design.
  • Proven experience with RAG and agentic AI systems and vector databases, plus SQL and NoSQL.
  • Experience with Azure AI / AI Foundry, AWS Bedrock or GCP.
  • DevOps and MLOps exposure, including Docker, Kubernetes and CI/CD pipelines.

What we offer

  • Compensation range of $77,000 to $117,000 annually.
  • Flexible benefits from day one and a market-leading personal time off policy.
  • Wellness reimbursement and opportunities for learning and development.
  • A blended work model combining office, client-site and virtual work.

Questions fréquentes

Le salaire proposé pour ce poste est de 77-117k CAD par an. Le détail figure dans l'annonce.
Cliquez sur "Postuler maintenant" en haut de la page. Vous pouvez importer votre CV en 1 clic — Jobiglo extrait automatiquement vos informations et postule pour vous.
Source : ats:workday

Why are you reporting this job?

Thank you for your report. We will review this job.

Apply in 30 seconds

Enter your email to apply. An account will be created automatically.

Apply now →

By continuing, you accept our terms of use.

Already have an account? Login

A question about this job?

Ask it here: you will get the full job summary by e-mail, right away.

Published 3 hours ago

Expires 1 month from now

4 views · 0 interested

Boost your chances

Upload your CV — we will match you with relevant openings.

Analyzing your CV...

bdo

Toronto - Bay St