AI Image Evaluation Analyst
We are looking for detail oriented analysts to evaluate and rank AI generated responses to image based prompts.
Hiring companyiMerit
About the role
Andromeda Callisto VCG
The work
You will judge answers on accuracy, relevance, clarity, conciseness, safety, localization, and how well they follow the user's instructions, then explain your reasoning in writing.
Much of the job comes down to this: look at the image, look at what the model said about it, and decide whether the two actually match.
Good to know
Independent contractor engagement for the length of the project.
Fully remote with flexible scheduling around agreed deadlines.
Volume varies with project demand.
Responsibilities
- Review images alongside the prompts and responses attached to them.
- Interpret both visual and conversational context before scoring anything.
- Compare multiple responses and rank them against defined criteria.
- Confirm that descriptions and claims about an image reflect what is actually there.
- Verify factual claims using approved research sources.
- Flag tasks that cannot be reliably evaluated.
- Write clear justification for every ranking you submit.
Required skills
- A sharp eye for visual detail and the patience to look twice.
- Strong critical thinking, research skills, and reading comprehension.
- Sound judgment and well supported decision making.
- Professional written English, including the ability to describe what you see precisely.
- The consistency to apply detailed guidelines the same way, task after task.
Preferred skills
- Experience in image annotation, content review, editing, research, design, or localization is welcome but not essential.
Equipment requirements
Tasks include visual content, so a device and connection that display images comfortably are required.
Assessment requirements
A paid qualification assessment is required before live work begins.
Schedule details
September 4, 2026 - October 31, 2026.
Eligibility
Work arrangement: Fully remote
Applicant eligibility: 6 eligible countries
View all 6 eligible countries
Eligible countries: France, Japan, Mexico, Norway, Türkiye, Vietnam
More about the hiring companyiMerit
