openaijobs.co
← All AI jobs — openaijobs.co

AI evaluation / training · Remote External project

AI Evaluation Rubric Auditor

Mercor · Remote

The work

Project auditor role testing AI agents on realistic shopping and delivery tasks: audit completed tasks — prompt and grading rubric — and judge whether rubric failures are fair, feeding back to reviewers on prompt and rubric issues.

Requirements

No specific experience requirement stated in the listing.

Job details

Company
Mercor
Category
AI evaluation / training
Location
Remote
Work model
Remote
Remote scope
Open to applicants in: AR, BO, Brazil, Canada, CL, CO, EC, United Kingdom, GY, PE, PY, UY, United States
Employment type
Hourly contract (independent contractor)
Pay
$60–$85 per hour
Posted
16 Nov 2026
Verified
Verified live 19 Nov 2026
Source
Mercor (work.mercor.com)
Job ID
mercor-ai-evaluation-rubric-auditor-x-2123355952510390750
AI EvaluationRubric AuditingLLM EvalsRemoteHourly

You apply on the employer’s site. openaijobs.co does not collect applications.

How to apply

  1. Check the “Open to applicants in” scope above — make sure you are eligible for this role before applying.
  2. Read the full requirements on the original listing.
  3. Apply via Apply Now below — it opens the employer’s listing in a new tab.