Side by Side Factuality Evaluator
We’re looking for English-fluent experts to engage on a project about the factual accuracy of AI-generated content.
Hiring companyMeridial by Invisible Technologies
About the role
As an independent contractor, you’ll review AI-generated responses, split them into individual claims, and check each claim against reliable sources. Your judgments will help build AI systems that give more accurate, trustworthy, and well-supported information.
This project may be a strong match for experts who:
- Have strong critical-thinking and analytical skills.
- Have strong web research skills and can tell reliable sources from unreliable ones.
- Pay close attention to detail, especially when spotting individual claims and subtle wording differences.
- Are comfortable researching many kinds of topics, including unfamiliar ones.
- Can understand detailed instructions and apply them consistently.
Contract and payment terms
- Contractor's services are provided on an independent contractor basis only and do not create any right or expectation of continued engagement or employment.
- Projects may be extended, shortened, or concluded early, including for reasons tied to project needs and the quality of deliverables; nothing in this engagement guarantees any minimum amount of work.
Responsibilities
Experts may be asked to:
- Review AI-generated responses on a wide range of topics.
- Break responses into individual, verifiable claims.
- Research each claim online and find credible, authoritative sources.
- Decide whether each claim is accurate, inaccurate, or unverifiable, paying close attention to small differences in wording.
- Make independent, evidence-based calls, including in ambiguous cases.
- Follow detailed evaluation guidelines and record clear, consistent decisions with supporting evidence.
Language requirements
- Are fluent in English, with strong reading comprehension and writing skills.
Schedule details
Any engagement is fully remote, can be completed on your own schedule, and contractors are free to accept or reject any project opportunity.
Eligibility
Work arrangement: Fully remote
We are unable to support H1-B or STEM OPT contractors at this time.
Compensation details
$16 per hour.
Payment for services provided will be issued weekly via Stripe or Wise.
More about the hiring companyMeridial by Invisible Technologies

