Domain Expert - Art
We are seeking a highly qualified Art Domain Expert to evaluate and improve Large Language Models (LLMs).
Hiring companyTuring
About the role
You will design challenging prompts, assess factual accuracy and reasoning, and identify knowledge gaps within fine arts, visual arts, architecture, design, art history, museums, and artists.
Employment type : Contractor assignment (no medical/paid leave).
Responsibilities
- Create advanced prompts covering fine arts, visual arts, architecture, design, art history, museums, and artists.
- Evaluate AI-generated responses for factual accuracy, reasoning quality, completeness, and nuance.
- Identify hallucinations, logical inconsistencies, outdated information, and edge cases.
- Develop benchmark datasets and adversarial test cases.
- Provide evidence-based feedback with reliable references.
- Collaborate with AI researchers to improve model performance.
- Maintain high annotation quality and documentation.
- Write domain-specific prompts of varying difficulty.
- Compare multiple AI responses and rank them.
- Explain why a response is correct or incorrect using authoritative references.
- Identify ambiguous questions and propose improved prompts.
Preferred skills
- Experience with LLMs, Generative AI, prompt engineering, or AI evaluation.
- Published research, industry recognition, or teaching experience is a plus.
- Ability to work independently and provide objective, evidence-backed reviews.
Experience and education
- Master’s degree or higher in any field; degrees in Art History, Fine Arts, Visual Arts, Museum Studies, Cultural Studies, Design, Humanities, or other art-related disciplines are preferred.
- Strong knowledge of art, including familiarity with major artists, artworks, art movements, styles, periods, techniques, museums, cultural traditions, and developments in visual arts.
- 3+ years of relevant professional experience, preferably in art research, academia, museums, galleries, curation, art criticism or journalism, education, publishing, arts and cultural content, or a related field.
- Strong attention to detail and ability to assess artistic, historical, and cultural information accurately and within the appropriate context.
Language requirements
- Excellent written English, research, and analytical skills.
Assessment requirements
Complete the assessment shared with you.
Our team will evaluate your submission.
Selected candidates will be contacted regarding the next steps.
Schedule details
Commitments Required: 40 hours per week with at least 4 hours PST overlap.
Duration of contract : 8 weeks.
Eligibility
Work arrangement: Fully remote
More about the hiring companyTuring
