Thriveth

The AI job market, made clearer

Find work worth
your expertise.

Back to all jobs

Applied Health & Medicine Benchmark Specialist

We are seeking expert medical and health science professionals to author and review high-quality academic assessment content for an AI research initiative.

Remote$94–$119 per hour
Hiring companyMercor
Application process4.0 / 5Based on 1 review
Work experience2.0 / 5Based on 1 review

About the role

You will write and verify rigorous multiple-choice questions across core health and medicine domains, evaluate solution quality, and help establish gold-standard benchmarks used to advance AI capabilities.

You will be assigned one of two task types:

  • Question Authoring — Create original, challenging multiple-choice questions in your area of medical expertise, rate their difficulty, and submit them for review.
  • Question Verification — Review pre-written questions for accuracy, clarity, and rigor. Edit where needed, rate difficulty, and document any changes made.

Health & Medicine Domains Covered

Clinical Medicine & Surgery, Medical Imaging & Diagnostics, Pharmacovigilance, Healthcare Management & Economics, Rehabilitation and Allied Health.

More About the Opportunity

  • Expected commitment: 10+ hours/week.
  • Asynchronous, fully remote work.

Contract and Payment Terms

  • You will be engaged as an independent contractor.
  • This is a fully remote role that can be completed on your own schedule.
  • Projects can be extended, shortened, or concluded early depending on needs and performance.
  • Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.

Responsibilities

  • Author original health and medicine questions that test deep conceptual understanding, not surface-level recall.
  • Ensure questions are unambiguous, self-contained, and precisely defined — all necessary information must be in the problem statement.
  • Rate each question's difficulty: Medium (intro undergraduate), Hard (advanced undergraduate), or Expert (post-graduate and above).
  • Provide 1 correct answer and 9 plausible but subtly incorrect alternatives that challenge expert-level solvers.
  • Write step-by-step Chain-of-Thought solutions with clear, concise reasoning in markdown format.
  • Supply 1–5 academic references per question from reputable sources (peer-reviewed journals, clinical guidelines).
  • For verification tasks: flag issues with clarity, completeness, precision, or solvability and justify any edits made.

Preferred skills

  • MD, DO, PhD, or doctoral candidate in Medicine, Biomedical Sciences, Public Health, or a closely related field.
  • Master's degree considered for candidates with exceptional depth in a specific subdomain.
  • Strong command of graduate-level medical knowledge, clinical reasoning, and biomedical research methodology.
  • Board certification, clinical experience, or research publications in health fields is a strong plus.
  • Excellent written English and ability to express complex ideas clearly and concisely.

Eligibility

Work arrangement: Fully remote

  • Please note: We are unable to support H1-B or STEM OPT candidates at this time.

Compensation details

$94–$119 per hour.

  • Payments are weekly on Stripe or Wise based on services rendered.
More about the hiring companyMercor
Find AI-training work. Know what to expect.

Thriveth makes AI data-training work easier to find, understand, and navigate. We replace uncertainty with clear opportunities, realistic expectations, and insights from real application journeys.