AI Test Architect
Location
medellín, valle de aburrá, antioquia
Job Type
Full-time
Category
Other-General
Posted
June 01, 2026
Why This Role Matters
Caseware is a leading Fintech company with a global audit and accounting software platform. We are accelerating an AI‑first future by embedding generative AI and autonomous agents to deliver smarter, faster user experiences.
What You’ll Be Doing
- 1. AI‑Driven Quality Strategy & Architecture
- Architect a comprehensive “Quality Intelligence” platform to predict defect hotspots, optimize regression suites, auto‑generate tests, and enable self‑healing automation.
- Define an enterprise‑wide AI‑first testing strategy, including continuous monitoring for drift, hallucination, and bias.
- Establish ethical governance for AI testing, aligning with emerging standards.
- 2. LLM & Agent Evaluation Frameworks
- Design advanced benchmarks, red‑team protocols, and adversarial testing for AI agents.
- Build evaluation pipelines using tools such as LangFuse, Lang...