Each task gives you a user request and the answers three different models gave to it. You classify the request (benign, dual-use or adversarial), mark each answer as safe or unsafe and say why, rank the three against each other, and write the answer the model should have given. For dual-use requests you also note what makes it sensitive, what legitimate purpose it serves, and who should be able to get an answer.

The requests are realistic: what synthetic and analytical chemists, toxicologists, industrial hygienists, process safety engineers, regulators and occasionally bad actors actually ask. Some are ordinary professional questions that models wrongly refuse, and catching those matters as much as catching the dangerous ones.

Before you apply

Open only to citizens or permanent residents of the US, UK, Canada, Australia, New Zealand and the European Union.

Why Work with SME Careers?

• Be a part of a forward-thinking team and help us train AI to communicate more effectively.
• Shape the Future of AI

  Your work directly contributes to how AI systems learn and communicate.

• Your Schedule, Your Rules

  Set your own hours and work around your life.

• Weekly Pay

  Receive fast, reliable payments once work is approved.

• Community Rewards

  Get rewarded for referrals with ongoing bonus income.

• Develop AI Training Content: Create detailed prompts in various topics and responses to guide AI learning, ensuring the models reflect a comprehensive understanding of diverse subjects.
• Optimize AI Performance: Evaluate and rank AI responses to enhance the model's accuracy, fluency, and contextual relevance.
• Ensure Model Integrity: Test AI models for potential inaccuracies or biases, validating their reliability across use cases.

• Synthetic and analytical chemists; toxicologists and pharmacologists; industrial hygienists and chemical safety/process safety professionals; CWC or chemical-security specialists; hazmat, poison-control or chemical incident responders; and chemical regulators (EPA, OSHA, HSE, OPCW-adjacent, or equivalent). Usually a relevant degree plus five or more years of professional experience. Experience with safety data sheets, exposure assessment, incident reports or regulatory review is a strong plus.

Required

Work arrangement: Fully remote

Applicant eligibility: 32 eligible countries · 1 eligible region