You will assess solutions for accuracy, clarity, and adherence to the prompt; identify errors in methodology or conceptual understanding; fact-check information; write high-quality explanations and model solutions that demonstrate correct methods; and rate and compare multiple AI responses based on correctness and reasoning quality. This is an hourly paid, fully remote contractor role with flexible work-from-anywhere hours. This job is with SME Careers (a subsidiary of SuperAnnotate), a fast-growing AI Data Services company providing training data for many of the world’s largest AI companies and foundation model labs—your work directly helps improve the world’s premier AI models.

Important: There is no immediate project for this role; however, if qualified, you will be among the first experts we reach out to when relevant opportunities arise. This will also provide you with access to future projects available through our expert network.

Why Work with SME Careers?

• Be a part of a forward-thinking team and help us train AI to communicate more effectively.
• Shape the Future of AI

  Your work directly contributes to how AI systems learn and communicate.

• Your Schedule, Your Rules

  Set your own hours and work around your life.

• Weekly Pay

  Receive fast, reliable payments once work is approved.

• Community Rewards

  Get rewarded for referrals with ongoing bonus income.

• Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects (Hebrew/English; requires C1+ English).
• Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance (Hebrew/English; requires C1+ English).
• Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases (Hebrew/English; requires C1+ English).

• Bachelor’s degree (or higher) in Linguistics, Translation, Hebrew Language, Communications, Journalism, or a related field.
• 3+ years of professional experience in translation, localization, editorial QA, content quality, or linguistic review (or equivalent).
• Excellent attention to detail and ability to apply detailed rubrics consistently in high-volume, hourly contractor work.
• Strong fact-checking habits and comfort validating claims using reputable sources when required by task guidelines.
• Ability to identify reasoning gaps, methodological errors, and unclear explanations—even when language is fluent.
• Comfort working independently in a remote, asynchronous environment with reliable availability and communication.
• Prior experience with AI data training, annotation, or evaluation workflows is strongly preferred.
• Familiarity with Israeli cultural context and terminology norms across common domains (news, education, consumer, tech) is preferred.

Required

Work arrangement: Fully remote

Eligible countries: Israel