Thriveth

The AI job market, made clearer

Find work worth
your expertise.

Back to all jobs

AI Developer Trace Task Auditor

Evaluate the quality and correctness of AI-assisted software-development traces used to train and evaluate a frontier AI lab's models.

United States
Hiring companyMercor
Application processN/ANo approved reviews yet
Work experienceN/ANo approved reviews yet

About the role

Contract and Payment Terms

  • You will be engaged as an independent contractor.
  • This is a fully remote role that can be completed on your own schedule.
  • Projects can be extended, shortened, or concluded early depending on needs and performance.
  • Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.

Responsibilities

  • You'll assess end-to-end coding sessions produced with AI-assisted developer tools — judging correctness, workflow soundness, and reasoning — and provide clear, rubric-based written feedback.

Required skills

  • 3+ years professional software development.
  • Hands-on experience with AI-assisted coding tools and agentic / spec-driven workflows (Cursor, GitHub Copilot, Claude Code, or similar).
  • Strong code-reading and debugging skills across full-stack or backend systems.
  • Ability to evaluate multi-step coding trajectories for correctness and best practice.

Preferred skills

  • Experience with Kiro or Amazon CodeCatalyst.
  • Prior work evaluating or grading AI-generated code.
  • Contributions to developer tooling.

Eligibility

Work arrangement: Fully remote

Eligible countries: United States

  • Please note: We are unable to support H1-B or STEM OPT candidates at this time.

Compensation details

  • Payments are weekly on Stripe or Wise based on services rendered.
More about the hiring companyMercor
Find AI-training work. Know what to expect.

Thriveth makes AI data-training work easier to find, understand, and navigate. We replace uncertainty with clear opportunities, realistic expectations, and insights from real application journeys.