QA Lead — AI Systems & Models Testing
Location
montreal, qc
Job Type
Full-time
Category
Management & Operations
Posted
May 21, 2026
QA Lead — AI Systems & Models Testing
Contract • Montreal, QC • AI / ML Testing • LLM / RAG / LangChain
About the Role
We are seeking an experienced QA Lead with deep expertise in AI systems testing to join our team on a contract basis in Montreal, Québec. This role sits at the intersection of quality engineering and artificial intelligence, requiring hands‑on proficiency in LLM behavior analysis, RAG pipeline validation, and modern AI orchestration frameworks. You will own the end‑to‑end test strategy for complex AI products and help define quality standards in a rapidly evolving space.
MUST-HAVE SKILLS
- Proven QA leadership experience designing and executing test strategies for AI/ML systems or LLM-powered applications.
- Strong understanding of LLM internals: tokenization, embeddings, attention mechanisms, and inference behavior to anticipate and diagnose failure modes.
- H...