Job Type: Remote / Contract / Flexible Hours
Pay Rate: $20.00 / hour
Location: Remote (Exclusively for US Citizens)
Datatricks AI is actively hiring remote evaluators for Project Edgehog, a specialized AI evaluation initiative focused on prompt analysis and visual output quality. In this role, you will analyze multimodal model generations, perform side-by-side image evaluations, and rate system accuracy according to strict benchmarking guidelines.
- Evaluate descriptive text prompts alongside model-generated image outputs.
- Conduct detailed, side-by-side image comparisons to assess fidelity, adherence to prompts, visual aesthetics, and model artifacts.
- Provide consistent, high-quality ratings and rankings based on project guidelines and rubrics.
- Flag inaccuracies, distortions, or hallucinations in generated visual assets.
- Citizenship: Must be a US Citizen (identity verification required).
- Strong written English and analytical skills with high attention to detail.
- Critical eye for visual discrepancies, layout artifacts, and image quality metrics.
- Reliable desktop/laptop computer with a stable high-speed internet connection.
- Ability to work independently while strictly maintaining annotation quality standards.
- Rate: $20.00 per hour tracked
- Hours: Flexible, remote schedule based on queue availability.
To be considered and get your account set up for Project Edgehog:
- Register: Visit https://datatricksai.us and complete your profile registration.
- Request Identity Verification: Email [email protected] with the subject line "Project Edgehog – Persona Verification Request" to receive your secure Persona verification link.
- Onboarding: Once your identity is confirmed, your account will be activated, and the initial qualification and onboarding guidelines will be unlocked.