Image Evaluator Expert

Image Evaluator Expert

Location: Los Angeles, CA (Remote)

Pay: $20 - $25/hr

Type: Part-time

Mercor is collaborating with a leading AI lab to identify detail-oriented image evaluation specialists for a project focused on assessing AI-powered image editing systems. In this project, you will evaluate how accurately and effectively AI models modify images based on user instructions. Your work will directly contribute to improving the quality, safety, and reliability of frontier multimodal models. This is a project-based opportunity suited for professionals with strong visual judgment and structured evaluation skills.

• Review original images, user edit instructions, and AI-generated edited images
• Conduct a pre-evaluation feasibility check to confirm the instruction is valid and achievable
• Flag unsafe, harmful, or policy-violating content in edited outputs
• Assess instruction adherence, structural integrity, and preservation of unedited areas
• Evaluate visual quality, style alignment, and character consistency
• Provide structured ratings across defined grading dimensions
• Deliver clear, consistent evaluations following detailed rubric guidelines

• Experience in image review, visual quality assurance, content moderation, or related fields
• Strong attention to detail and ability to identify subtle visual inconsistencies
• Familiarity with image editing concepts, digital art, or generative AI systems
• Ability to apply structured evaluation rubrics consistently and objectively
• Clear written communication skills for documenting assessments
• Comfort reviewing a wide range of visual content, including potentially sensitive material

• Submit your resume or professional background to express interest
• Complete a short screening assessment to demonstrate evaluation skills
• Selected candidates will receive detailed project guidelines and next steps
• Communication regarding status and next steps typically occurs within a few business days

• You will be engaged as an independent contractor.
• This is a fully remote role that can be completed on your own schedule.
• Projects can be extended, shortened, or concluded early depending on needs and performance.
• Your work at Mercor will not involve access to confidential or proprietary information from any employer, client, or institution.
• Payments are weekly on Stripe or Wise based on services rendered.
• Please note:
  
  We are unable to support H1-B or STEM OPT candidates at this time.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.

Apply here and check the explore section for other positions:

Mercor is a fast-growing AI-driven hiring and expert-training marketplace that connects highly skilled professionals (e.g., engineers, doctors, lawyers, researchers) with work that helps train and refine artificial intelligence systems. It uses AI to automate resume screening, candidate matching, and evaluation so organizations can find top talent more efficiently and with less bias than traditional recruiting. Since its founding in 2023 by Brendan Foody, Adarsh Hiremath, and Surya Midha, Mercor has seen rapid growth, significant funding, and industry recognition — including raising large venture rounds including a $100M Series B at a $2B valuation, and earning spots on influential startup lists — while building a large global talent pool and serving major AI labs and tech companies.

Today, Mercor is widely regarded as one of the leading platforms reshaping how expertise is sourced, evaluated, and used in AI development, blending human judgment with machine learning to support better hiring decisions and AI training outcomes.