Professional Services AI Training Specialist — Task Creation & Model Evaluation (Contract)
As a Professional Services AI Training Specialist at Rise Data Labs, you will play a crucial role in training and enhancing AI models specifically tailored for the professional services domain.
Hiring companyRise Data Labs
About the role
This role goes beyond traditional annotation and labeling — you'll author realistic, economically valuable professional services tasks and rubrics based on real client work, then grade AI-generated deliverables against them. We're especially focused on accounting and audit expertise right now, but are open to related professional service backgrounds as well.
What We Offer
- At Rise Data Labs, we value our contributors and strive to create a supportive, flexible working environment.
- We offer opportunities for professional development in the AI field and the chance to work on innovative projects that directly shape the future of AI in professional services work.
Responsibilities
- Create realistic task scenarios based on real client or engagement work — e.g., reviewing financial statements and audit workpapers, building a consulting deliverable, preparing an HR or compliance report, or drafting a client-facing proposal or analysis.
- Supply the kinds of reference materials you'd normally work from (financial statements, engagement letters, project reports, supporting schedules).
- Write detailed rubrics specifying exactly what a correct deliverable requires — accurate figures/formulas, proper file structure, professional formatting.
- Grade AI-generated deliverables (often Excel workbooks, Word documents, or PDF reports) against your rubric.
- Join calibration sessions with other experts to ensure consistent scoring across the benchmark.
Preferred skills
- Prior hands-on experience in one or more of: accounting/audit (CPA or equivalent preferred), management or strategy consulting, HR, marketing/business services, or another professional services engagement-based role.
- Comfort reviewing detailed client-facing work product line by line.
- Prior experience with AI model training, evaluation, or benchmark development is a plus.
Eligibility
Work arrangement: Fully remote
Eligible locations: Worldwide
More about the hiring companyRise Data Labs
TeracRL Environment Builder: Experienced QuickBooks User (Accounting and Sales Operations)
We're building reinforcement learning environments grounded in real accounting and sales workflows, and we're looking for QuickBooks experts to help create them.
TeracTechnical Accounting and FP&A Experts: AI Training Scenarios
We're hiring technical accounting and FP&A experts to help build reinforcement learning environments for AI systems.