AI Evaluation Analyst – Financial Data

• CRISIL is a leading, agile and innovative global analytics company driven by its mission of making markets function better.
• It has delivered independent opinions, actionable insights, and efficient solutions to over 100,000 customers through businesses that operate from India, the US, the UK, Argentina, Colombia, Poland, China, Hong Kong and Singapore.
• It is majority owned by S&P Global Inc, a leading provider of transparent and independent ratings, benchmarks, analytics and data to the capital and commodity markets worldwide

Job Description

What is the opportunity?

This role will offer an opportunity to contribute to the development of trusted, high-performing AI models by validating their outputs against authoritative sources and identifying opportunities for improvement.

What will you do?

• Evaluate AI model responses for accuracy, hallucinations, and information capture rate against ground truth sources...