LLM Reasoning, Factuality & Rubric Rating Roles
Assess model hallucinations, rate multi-turn conversations on helpfulness and honesty, check mathematical derivations, and grade complex logical reasoning traces.
Benchmark Tip
Review official platform evaluation guidelines carefully before taking baseline exams
Benchmark Tip
Always cite primary authoritative sources when flagging hallucinations
Benchmark Tip
Write concise, rubric-aligned justifications for every score
Verified AI Evaluation Opportunities (5)
Each listing displays sourced compensation rates and verified country eligibility.
Autonomous AI Agent Evaluator & Task Benchmark Contributor
Benchmark and train autonomous AI agent systems executing complex multi-step reasoning, tool invocations, web navigation, and real-world task execution. Annotate agent trajectory traces, critique planning failures, and supply high-signal correction feedback.
AI Model Contributor & Domain Specialist (Move Program)
Join the official Handshake Move Program connecting students, recent graduates, and early-career specialists to paid AI model development. Contribute high-quality domain responses, evaluate reasoning chains, and assist leading AI developers in training specialized models.
LLM Reasoning & Factuality Evaluator
Evaluate complex multi-step reasoning chains in AI responses. Verify truthfulness against scholarly sources, ensure adherence to logical constraints, and grade hallucination severity.
Multimodal Model Response & Safety Rater
Compare side-by-side outputs from vision-language models. Rate image captioning quality, visual reasoning, chart interpretation, and safety filter adherence according to detailed rubric guides.
AI Search Relevance & Reasoning Analyst
Evaluate the intent and precision of conversational AI search engines. Grade web citation authority, verify synthesized summaries, and detect out-of-date or contradictory search snippets.
Get Matched to AI Evaluation Gigs
Upload your resume or build your candidate profile to receive deterministic skill fit scores and real-time country eligibility verification.