Thriveth

The AI job market, made clearer

Find work worth
your expertise.

Back to all jobs

AI Response Evaluation Analyst

You will review AI generated responses and decide which ones actually hold up: accurate, relevant, concise, safe, well localized, and true to what the user asked for.

6 eligible countries
Hiring companyiMerit
Application processN/ANo approved reviews yet
Work experienceN/ANo approved reviews yet

About the role

Andromeda Callisto AFM

The work

Every ranking comes with a short written rationale, and those comments feed directly into how the models improve.

Careful reading and good judgment matter far more than speed here.

Good to know

Independent contractor engagement for the length of the project.

Fully remote and flexible. You choose your hours as long as volume and deadlines are met.

Task volume varies with project demand.

Responsibilities

  • Interpret conversational context and identify what the user really wanted.
  • Rate and rank responses against defined quality criteria.
  • Compare multiple answers and explain in writing why one wins.
  • Verify factual claims using approved research sources.
  • Flag tasks that cannot be reliably assessed rather than guessing.

Required skills

  • Strong critical thinking and sound judgment in ambiguous cases.
  • Solid research skills and attention to detail.
  • Excellent reading comprehension.
  • Professional written English that is clear and concise.
  • Self direction and the discipline to hit deadlines without supervision.

Preferred skills

  • Prior experience in AI evaluation, annotation, writing, editing, research, or translation is a plus, though not required.

Assessment requirements

A paid qualification assessment is required before live work begins.

Schedule details

September 4, 2026 - October 31, 2026.

Eligibility

Work arrangement: Fully remote

Applicant eligibility: 6 eligible countries

View all 6 eligible countries

Eligible countries: France, Japan, Mexico, Norway, Türkiye, Vietnam

More about the hiring companyiMerit
Find AI-training work. Know what to expect.

Thriveth makes AI data-training work easier to find, understand, and navigate. We replace uncertainty with clear opportunities, realistic expectations, and insights from real application journeys.