If you enjoy applying legal reasoning, analyzing complex cases, and providing clear, structured feedback, this is your chance to put your expertise to work in a new way.
Your background in U.S. law is exactly what’s needed to shape how the next generation of AI understands and reasons about legal systems.
Responsibilities
Review and evaluate AI-generated responses to U.S. legal hypotheticals across multiple areas of law.
Apply a structured legal rubric to assess issue spotting, accuracy, reasoning, and application of law.
Identify gaps, edge cases, and blind spots in legal reasoning, helping define benchmarks for legal AI performance.
Provide detailed, high-quality annotations and written feedback to refine AI models.
Collaborate with researchers and project managers to align evaluation standards and project goals.
Required skills
Strong reasoning skills across core areas of U.S. law.
Excellent written communication and attention to detail.
Experience and education
Juris Doctor (J.D.) from an accredited U.S. law school; Bar admission (active).
3+ years of U.S. legal practice.
High ethical standards; priori experience in AI annotation is a plus.
Assessment requirements
AI interview (~25 minutes).
Resume and overall application review.
Offer
Schedule details
Required commitment: total 40 hours spread across 4 weeks.
Eligibility
Work arrangement: Fully remote
Compensation details
Up to $150 per hour.
Pay up to $150/hr depending on internal evaluation and location.
Thriveth makes AI data-training work easier to find, understand, and navigate. We replace uncertainty with clear opportunities, realistic expectations, and insights from real application journeys.