IT
AI Response Evaluator
iMerit TechnologyVerified
Contract type
One-time
Work mode
100% remote
Experience
3 years
Job description
Key details
- Evaluate and rank AI-generated responses to image-based prompts on accuracy, relevance, clarity, conciseness, safety, localization, and instruction-following
- Interpret conversational context and identify what the user really wanted
- Rate and rank responses against defined quality criteria
- Compare multiple answers and explain in writing why one wins
- Verify factual claims using approved research sources
- Flag tasks that cannot be reliably assessed rather than guessing
- Company mission
- Information not specified
Benefits
- Fully remote and flexible work
- You choose your hours as long as volume and deadlines are met
Requirements & details
- Strong critical thinking and sound judgment in ambiguous cases
- Solid research skills and attention to detail
- Excellent reading comprehension
- Self-direction and the discipline to hit deadlines without supervision
- Independent contractor engagement for the length of the project
- Task volume varies with project demand
- Information not specified
- Uncategorized