AI Engineer (Large Language Models & RAG)
bdo · Toronto - Bay St
Job description
About the role
BDO is hiring an experienced AI Engineer in Toronto to design, build and deploy production-grade AI solutions that bridge experimental machine learning with scalable software engineering. The role focuses on large language models (LLMs), retrieval-augmented generation (RAG) and agentic workflows, within established governance frameworks.
Key responsibilities
- Design, build and deploy scalable AI applications using LangChain, LlamaIndex, AutoGPT and related LLM orchestration tools.
- Develop, refine and optimize prompts, manage model context windows and fine-tune models where needed.
- Integrate AI into enterprise environments via RESTful APIs, microservices and cloud-native architectures.
- Maintain vector databases (Pinecone, Milvus, Weaviate) and build data ingestion and embedding pipelines for RAG.
- Monitor production systems and address hallucinations, latency, reliability, scalability and token-cost issues.
- Collaborate with AI Architects, ML Engineers, Data Scientists, developers and citizen developers on firm-wide initiatives.
- Support documentation, lifecycle management and control processes aligned with ISO/IEC 42001, and adhere to AI risk, data governance and security policies.
- Take part in model testing and validation under the NIST AI Risk Management Framework.
Required profile
- Bachelor's or Master's degree in Computer Science, Engineering or a related field.
- 3-5 years of professional experience in AI, machine learning or applied software engineering.
- Expert-level Python, with working familiarity in Java and/or TypeScript.
- Hands-on experience with OpenAI APIs, Anthropic, Hugging Face, LangGraph and LLM-based application design.
- Proven experience with RAG and agentic AI systems and vector databases, plus SQL and NoSQL.
- Experience with Azure AI / AI Foundry, AWS Bedrock or GCP.
- DevOps and MLOps exposure, including Docker, Kubernetes and CI/CD pipelines.
What we offer
- Compensation range of $77,000 to $117,000 annually.
- Flexible benefits from day one and a market-leading personal time off policy.
- Wellness reimbursement and opportunities for learning and development.
- A blended work model combining office, client-site and virtual work.
Questions fréquentes
Why are you reporting this job?
Explore further
Salaries, guides and searches in Canada.
Salaries by job title
Apply in 30 seconds
Enter your email to apply. An account will be created automatically.
By continuing, you accept our terms of use.
Already have an account? Login
A question about this job?
Ask it here: you will get the full job summary by e-mail, right away.
Published 3 hours ago
Expires 1 month from now
4 views · 0 interested
Boost your chances
Upload your CV — we will match you with relevant openings.
Analyzing your CV...
bdo
Toronto - Bay St
Related job offers
-
Full Stack Developer, Tax Transformation Office
bdo Toronto - Bay St -
Consultant, Modern Workplace Technology
bdo Toronto - Bay St -
Senior SCM Functional Consultant - Dynamics 365 F&O Managed Services
bdo Toronto - Bay St -
Programmeur·euse compétitif·ve – Benchmarks IA (Remote)
Vettedlance -
Enregistreur de flux de travail pour outils de développement (éditeurs de code, IDE, clients API)
Vettedlance