Employment Type: Contractor assignment (no medical/paid leave).

Duration of Contract: 5 weeks (expected start date is next week).

You will design tasks where AI agents must independently navigate scientific data, write and execute code, use computational tools, troubleshoot intermediate results, and produce scientifically valid final outputs.

The goal is to evaluate whether AI systems can perform authentic multi-step scientific work — not simply answer scientific questions.

• Design challenging, realistic agentic scientific workflows across the life sciences, requiring multiple computational steps rather than single-script or simple question-answer solutions.
• Develop realistic input files, scientific datasets, instructions, constraints, and expected deliverables.
• Build tasks requiring agents to inspect data, select appropriate methods, execute analyses, troubleshoot problems, and synthesize results.
• Create reproducible expert solutions and objectively verifiable ground truths, along with robust automated or semi-automated grading criteria.
• Validate scientific assumptions, calculations, code, intermediate outputs, and final answers, ensuring tasks are self-contained and executable in controlled, network-isolated environments.

• Ph.D., postdoctoral, or equivalent research experience in the life sciences, with strong demonstrated computational and scientific-programming experience.

Work arrangement: Fully remote

Payment Type: Pay per task — $300 per approved task.