C
Data Annotator - Video Evaluation (Remote, Flexible, Worldwide)
Careerflow
-
Full-Time
0-3 Years experience
Description
About the Role
A US based AI company that is at the forefront of AI research is looking for a detail-oriented and analytically consistent Annotator to evaluate visual and creative content using structured rating frameworks and detailed guidelines.
In this role, you will assess AI-generated and real-world media (images and videos) for quality, realism, composition, and adherence to defined evaluation standards. Your work will directly contribute to improving cutting-edge AI systems.
This position requires strong visual judgment, structured reasoning, and consistency across high-volume evaluation tasks.
What You Will Do
- Evaluate visual and media content using structured guidelines and predefined rating frameworks.
- Provide clear, well-structured written justifications to support evaluation decisions.
- Ensure consistency, accuracy, and attention to detail across high-volume annotation tasks.
- Identify quality gaps related to realism, composition, motion, lighting, and overall production standards.
Job Requirements
- 3+ years of professional work experience
- Media/agency experience is mandatory
- Hands-on experience working directly with designers, photographers, or videographers (mandatory)
- Experience with AI image or video generation tools is a strong plus
- Strong understanding of motion realism, lighting, camera movement, composition, and production quality
- Strong analytical, logical reasoning, and research skills and excellent communication and collaboration abilities, with proficiency in English.
- Incorporate feedback from LLM performance metrics into training data creation.
- Ability to commit to 40 hours per week and candidates who can join immediately preferred.
Required Qualifications
Bachelor's degree or higher in:
- Design, Visual Communication, or Fine Arts
- Film, Media, Animation, or VFX
- Photography or Cinematography
- Architecture or Industrial Design
- Creative Writing or equivalent professional experience in content creation, media production, or content review.
Application Process
- Submit your resume, profile, and questionnaire here on this job description
- If you are selected, you will receive an Interest Confirmation Form (ICF)
- An Assessment will be shared after 2-3 days of application.
- If you pass the assessment, you can start immediately
Pay, Compensation, and further details
- Pay: $2.5 to $3.5 per hour depending on experience*(Approximately Rs. 40,000 per month for 40 hours per week)*
- Assignment Type: Independent Contract
- Total Number of Positions: 350
- Start Date: May 28th, 2026
- Commitment Required: 40 hours per week (6 hours overlap with PST)
- Years of Experience: 3 Years of Experience required
- Engagement Length: 4 weeks
About Careerflow
-
