Thriveth

The AI job market, made clearer

Find work worth
your expertise.

Back to all jobs
Added New on Thriveth

Tooling Engineer

We are seeking highly qualified Domain Experts (SMEs) to support the evaluation, testing, and improvement of advanced Large Language Models (LLMs).

Remote
Hiring companyTuring
Application process2.0 / 5Based on 1 review
Work experienceN/ANo approved reviews yet

About the role

You will apply your subject-matter expertise to assess AI-generated responses, identify knowledge gaps, design challenging prompts, and improve model accuracy, reliability, and reasoning.

  • Strong analytical and critical-thinking abilities.
  • Exceptional attention to detail.

The ideal candidate is curious, detail-oriented, and deeply knowledgeable in their field. They enjoy solving complex problems, challenging assumptions, and identifying subtle factual or reasoning errors. Experience designing prompts that uncover model limitations and improve AI performance will be a strong advantage.

Responsibilities

  • Create complex, domain-specific prompts to test LLM capabilities.
  • Evaluate AI-generated responses for factual accuracy, reasoning, relevance, and overall quality.
  • Identify factual errors, logical inconsistencies, knowledge gaps, and model weaknesses.
  • Develop challenging test cases and edge cases that expose model limitations.
  • Provide clear, detailed, and evidence-based feedback to improve model performance.

Preferred skills

  • Experience working with LLMs or Generative AI.
  • Familiarity with prompt engineering, AI evaluation, or model testing.
  • Experience designing challenging prompts, identifying edge cases, or stress-testing AI models.

Experience and education

  • Master’s degree or higher in a relevant field.
  • At least three years of professional, research, or teaching experience.

Language requirements

  • Excellent written English communication skills.

Eligibility

Work arrangement: Fully remote

More about the hiring companyTuring
Find AI-training work. Know what to expect.

Thriveth makes AI data-training work easier to find, understand, and navigate. We replace uncertainty with clear opportunities, realistic expectations, and insights from real application journeys.