Intermediate AI Quality Engineer - Agentic Systems

We're partnering with a global health‑tech scale‑up with roots in South Africa, delivering agentic AI systems into real production healthcare environments in the US. This is not an experimental role. These systems are live, scaling, and solving real clinical workflows now.

We're looking for a sharp AI Quality Engineer to own one of the hardest problems in applied AI: How do you make autonomous systems reliable enough for healthcare?

You’ll design the quality engine behind production AI systems — ensuring outputs are accurate, safe, measurable, and trusted by clinicians. If you’re excited by high‑stakes AI, complex systems, and real‑world impact, this is the seat.

WHAT YOU WILL BE BUILDING (AND OWN)

• Prompt lifecycle systems, version control, testing, and structured output enforcement
• Golden datasets and evaluation frameworks for LLM performance
• Automated regression detection across prompts, models, and workflows