Quality Assurance AI Engineer at IDC
Location
toronto, on
Job Type
Full-time
Category
Engineering
Posted
June 04, 2026
Become a key player at IDC as an AI Engineer specializing in Observability and Quality, focusing on enhancing AI response accuracy. This role is remote and pivotal for establishing quality standards.
In this solo role, you’ll design comprehensive evaluation frameworks that bolster the integrity and performance of our AI platform. Your work will involve developing automated test suites and monitoring tools that facilitate high-quality delivery to users, ensuring our AI systems remain reliable and trusted.
Key Responsibilities:
• Establish evaluation systems for AI response quality
• Develop automated testing frameworks and regression detection
• Create metrics for tracking quality and citation accuracy
• Collaborate with product teams to define quality criteria
• Monitor AI execution for operational effectiveness
Requirements:
• 6+ years in software engineering focused on ML or testing
• Expertise in Python...
In this solo role, you’ll design comprehensive evaluation frameworks that bolster the integrity and performance of our AI platform. Your work will involve developing automated test suites and monitoring tools that facilitate high-quality delivery to users, ensuring our AI systems remain reliable and trusted.
Key Responsibilities:
• Establish evaluation systems for AI response quality
• Develop automated testing frameworks and regression detection
• Create metrics for tracking quality and citation accuracy
• Collaborate with product teams to define quality criteria
• Monitor AI execution for operational effectiveness
Requirements:
• 6+ years in software engineering focused on ML or testing
• Expertise in Python...