Senior Software Engineer, Product AI - AI Powered Platform
Location
toronto, on
Job Type
Full-time
Category
IT & Technology
Posted
May 26, 2026
Senior Software Engineer — Product AI Ship AI-powered product features. You’ll integrate LLMs and ML services into user workflows, build evaluation frameworks, and ensure safety, reliability, and measurable outcomes.
What You’ll Do
Design APIs and services that incorporate LLM/NLP and retrieval (RAG, embeddings).
Build evaluation harnesses, guardrails, and offline/online metrics for quality.
Optimize cost/latency via prompt design, tuning, distillation, and caching.
Instrument features for A/B testing and impact analysis.
Collaborate with research, data, and product to iterate rapidly.
What We’re Looking For
5+ years in software; 2+ years in applied ML/LLMs preferred.
Proficiency in Python and one backend stack (Go/Node/Java).
Experience with vector stores and ML ops in cloud.
Strong product instincts and data-driven decision making.
About Andiamo Talent Partners for the AI Revol...
What You’ll Do
Design APIs and services that incorporate LLM/NLP and retrieval (RAG, embeddings).
Build evaluation harnesses, guardrails, and offline/online metrics for quality.
Optimize cost/latency via prompt design, tuning, distillation, and caching.
Instrument features for A/B testing and impact analysis.
Collaborate with research, data, and product to iterate rapidly.
What We’re Looking For
5+ years in software; 2+ years in applied ML/LLMs preferred.
Proficiency in Python and one backend stack (Go/Node/Java).
Experience with vector stores and ML ops in cloud.
Strong product instincts and data-driven decision making.
About Andiamo Talent Partners for the AI Revol...