Thriveth

The AI job market, made clearer

Find work worth
your expertise.

Back to all jobs

AI Fact-Checking & Response Evaluation Reviewer (French)

Apply independent judgment to identify AI blind spots, reasoning failures, factual inaccuracies, contradictory evidence, and quality gaps.

France
Hiring companyTrustScale
Application processN/ANo approved reviews yet
Work experienceN/ANo approved reviews yet

About the role

Successful reviewers do not simply validate AI-generated conclusions—they critically evaluate them. Your role is to verify evidence, challenge unsupported assumptions, and ensure AI systems learn from accurate, reliable, and well-supported information.

Your expertise will help build more reliable, trustworthy, and human-centered AI systems.

At TrustScale, we believe AI improves when people are willing to question it.

As an AI Fact-Checking & Response Evaluation Reviewer, you will evaluate AI-generated responses, verify evidence, challenge unsupported conclusions, and help define the standards that AI systems learn from.

Good AI is built on good judgment.

TrustScale is seeking experienced French -language professionals to evaluate AI-generated responses, verify factual accuracy, assess supporting evidence, and help define the quality standards that AI systems learn from.

As an AI Fact-Checking & Response Evaluation Reviewer, you will review AI-generated content, determine whether conclusions are supported by evidence, identify reasoning gaps, challenge unsupported claims, and help improve the reliability of next-generation AI systems.

This is not a traditional annotation, translation, or data-entry role.

This role requires individuals who are comfortable questioning conclusions, investigating claims, and making evidence-based decisions—even when those decisions differ from AI-generated recommendations.

The strongest reviewers are naturally curious, skeptical of unsupported claims, detail-oriented, and confident applying their own judgment when evaluating information.

This is a remote freelance opportunity with flexible hours and payment in USD.

We are seeking a small group of experienced reviewers to support upcoming AI quality initiatives. Applications are reviewed on a rolling basis.

Why Join TrustScale

  • 100% remote and flexible work environment.
  • Paid in USD.
  • Work on cutting-edge AI and language technologies.
  • Collaborate with a global network of AI quality professionals.
  • Long-term opportunities for high-performing contributors.
  • Potential growth into advanced AI Quality, Fact-Checking, and QC Specialist roles.
  • Help shape how AI systems evaluate information and make decisions.
  • Contribute directly to the development of safer, more reliable, and more trustworthy AI systems.

As an AI Fact-Checking & Response Evaluation Reviewer, your evaluations help determine whether AI-generated conclusions are supported by evidence, grounded in facts, and aligned with user needs. Your expertise helps define what good looks like—and your judgment becomes part of the foundation from which AI learns.

Limited openings available. Early applications are encouraged.

Responsibilities

  • Review and evaluate AI-generated responses in French.
  • Verify factual claims using reliable online sources and supporting evidence.
  • Assess whether evidence supports, contradicts, or fails to support AI-generated conclusions.
  • Identify AI blind spots, reasoning failures, factual inaccuracies, and quality gaps.
  • Evaluate response quality, relevance, completeness, and alignment with user intent.
  • Detect inconsistencies, unsupported claims, contradictory information, and missing evidence.
  • Apply independent judgment rather than relying solely on automated decisions.
  • Challenge AI-generated conclusions when evidence suggests a different outcome.
  • Provide clear quality feedback and rationale for review decisions.
  • Participate in training, calibration, and quality alignment sessions conducted in English.
  • Maintain quality, consistency, commitment, and productivity expectations while meeting project requirements.
  • Collaborate with project teams to continuously improve reviewer standards and AI quality outcomes.

What Success Looks Like

Successful reviewers:

  • Verify information before accepting conclusions.
  • Challenge AI-generated decisions when evidence suggests otherwise.
  • Distinguish between supported, unsupported, and contradictory claims.
  • Remain objective when evaluating information.
  • Demonstrate consistency across complex review tasks.
  • Maintain strong productivity while preserving quality standards.
  • Use evidence rather than assumptions to make decisions.
  • Take ownership of quality outcomes.
  • Demonstrate reliability and commitment throughout the project lifecycle.

Required skills

  • Excellent critical-thinking and analytical skills.
  • Strong evidence-based decision-making abilities.
  • Strong attention to detail and consistency.
  • Ability to independently evaluate and challenge AI-generated conclusions.
  • Ability to distinguish between factual support, contradiction, and insufficient evidence.
  • Ability to interpret complex queries and assess response quality accurately.
  • Comfortable working with structured data and AI-related projects.
  • Comfortable working with ambiguity and incomplete information.

Preferred skills

  • Experience reviewing AI training data or annotation projects.
  • Experience with Response Evaluation, Search Quality Rating, RLHF, LLM evaluation, AI model assessment, or human-in-the-loop review workflows.
  • Experience in Fact-Checking, Trust & Safety, Information Verification, or Online Research.
  • Background in journalism, research, education, editorial review, investigation, or content quality assessment.
  • Experience providing quality feedback, coaching, or calibration support to reviewer teams.
  • Experience working with time-sensitive content such as news, public information, sports, finance, or search-related content.

Experience and education

  • Previous experience in Fact-Checking, Quality Assurance, Content Review, Search Evaluation, Annotation Review, Trust & Safety, Data Quality, Linguistic QA, Research Analysis, or similar analytical roles.

Language requirements

  • Native or near-native fluency in French.
  • Strong English proficiency, including the ability to understand guidelines and participate in training sessions.

Assessment requirements

Ability to pass a qualification assessment in English/French.

Due to the specialized nature of AI quality work, selected candidates will complete a qualification process before onboarding.

This process may include guideline reviews, platform training, UI navigation exercises, knowledge assessments, fact-checking exercises, and project simulation tasks designed to evaluate quality, accuracy, consistency, critical thinking, decision-making skills, and overall readiness for project work.

All qualification activities are unpaid and form part of the candidate evaluation process. Successful completion does not guarantee project placement, as final selection is based on assessment performance, demonstrated commitment, consistency of quality, project requirements, and available capacity.

TrustScale seeks contributors who consistently deliver high-quality work, actively engage with project requirements, demonstrate reliability, and maintain strong reviewer judgment throughout the project lifecycle.

Eligibility

Work arrangement: Fully remote

Eligible countries: France

More about the hiring companyTrustScale
Find AI-training work. Know what to expect.

Thriveth makes AI data-training work easier to find, understand, and navigate. We replace uncertainty with clear opportunities, realistic expectations, and insights from real application journeys.