Thriveth

The AI job market, made clearer

Find work worth
your expertise.

Back to all jobs
Posted 22 Sept 2026

Sales & Revenue Operations Task Author (AI Training)

Alignerr is building a dataset of expert tasks that train and evaluate advanced AI agents on real enterprise work.

United States, New York metro area$20–$50 per hour
Hiring companyAlignerr
Application processN/ANo approved reviews yet
Work experienceN/A1 of 3 reviews needed

About the role

As a Task Author for the Sales / Revenue Operations role, you will design and calibrate realistic problems that challenge AI agents performing the kinds of work a revenue operations professional faces daily — reconciling account data across CRM, orders, email, and chat to arrive at one defensible answer.

This is a fully remote, flexible contract role ideal for experienced RevOps and SalesOps professionals in the New York metro area who want to apply their enterprise expertise to cutting-edge AI development.

Responsibilities

  • Author realistic task prompts grounded in revenue operations scenarios — bookings reconciliation, account discrepancies, fulfillment status, and recognized revenue.
  • Write scoring rubrics that define exactly what a correct answer looks like and how it is evaluated.
  • Set up task environments so an AI agent enters a realistic work situation with the same business systems a human employee would use.
  • Solve each task yourself to validate soundness and confirm the rubric is accurate.
  • Calibrate task difficulty — test tasks against AI models and adjust complexity, ambiguity, or steps until the task reliably challenges the model to the intended degree while remaining objectively gradable.
  • Review and correct AI-drafted task prompts or rubrics when provided.

Required skills

  • Deep familiarity with CRM systems (e.g., Salesforce) and the ability to query and interpret account and bookings data.
  • Strong understanding of bookings, fulfillment pipelines, and revenue recognition concepts.
  • Ability to define precise, verifiable correctness criteria — not just "good judgment" but a standard that can be checked.
  • Iterative mindset: willing to test, refine, and re-test until a task is correctly calibrated.
  • Comfort operating business communication tools (email, chat) and dashboards as part of multi-system workflows.

Preferred skills

  • Experience training or evaluating AI tools in a sales or revenue context.
  • Background in enterprise B2B environments with complex deal structures.

Experience and education

  • Hands-on experience in revenue operations, sales operations, or a closely related function at an industrial or enterprise company.
  • The strongest candidates have done this job in industry, are comfortable with the everyday software of their domain, and can describe — concretely — how they would build a task that reliably challenges a capable AI agent while remaining clearly and objectively gradable.

Schedule details

Flexible

Eligibility

Work arrangement: Fully remote

Eligible countries: United States

Eligible regions: New York metro area

Compensation details

$20–$50 per hour.

More about the hiring companyAlignerr
Find AI-training work. Know what to expect.

Thriveth makes AI data-training work easier to find, understand, and navigate. We replace uncertainty with clear opportunities, realistic expectations, and insights from real application journeys.