Quality Engineering Specialist
Location
Mumbai, Maharashtra
Job Type
Full-time
Category
Engineers
Posted
June 02, 2026
Quality Engineer Specialist – AI & LLM Solutions
We are looking for a
QA Engineer Specialist specializing in AI and LLM-based systems
to ensure the quality, reliability, and performance of AI products used across global media and marketing platforms. The role focuses on testing
LLMs, RAG pipelines, AI agents, and ML/data workflows , with a strong emphasis on
automation and AI-specific quality metrics .
Key Responsibilities
Own quality assurance for
AI products , including LLMs, RAG systems, agents, and ML pipelines.
Design and execute
AI-specific test strategies
(factuality, hallucinations, robustness, safety).
Validate
agent behaviors , AI outputs, and performance (latency, stability, quality).
Build and maintain
automated test suites
integrated into CI/CD pipelines.
Prevent regressions and assess the impact of
model, embedding, or prompt changes .
Col...
We are looking for a
QA Engineer Specialist specializing in AI and LLM-based systems
to ensure the quality, reliability, and performance of AI products used across global media and marketing platforms. The role focuses on testing
LLMs, RAG pipelines, AI agents, and ML/data workflows , with a strong emphasis on
automation and AI-specific quality metrics .
Key Responsibilities
Own quality assurance for
AI products , including LLMs, RAG systems, agents, and ML pipelines.
Design and execute
AI-specific test strategies
(factuality, hallucinations, robustness, safety).
Validate
agent behaviors , AI outputs, and performance (latency, stability, quality).
Build and maintain
automated test suites
integrated into CI/CD pipelines.
Prevent regressions and assess the impact of
model, embedding, or prompt changes .
Col...