ML Evaluation Designer - Expert
Location
Dublin, County Dublin
Job Type
part-time
Category
Computer Occupations
Posted
June 17, 2026
About the job
Mercor connects elite creative and technical talent with leading AI research labs. Headquartered in San Francisco, our investors include Benchmark, General Catalyst, Peter Thiel, Adam D'Angelo, Larry Summers, and Jack Dorsey.
Position: Code-Data Eval Author — Machine Learning Engineer
Type: Contract
Compensation: $45–$140/hour
Location: Remote
Commitment: 30+ hours/week
Role Responsibilities
- Design ML/LLM evaluation tasks, rubrics, and metrics to enhance model performance.
- Grade model/agent outputs and improve evaluation quality through thorough review.
- Apply training-side judgment...