AI Evaluation Specialist – Remote (up to $70/hr)

About the role

We are seeking a remote AI Evaluation Specialist to assess AI‑generated content for quality, clarity, and usability. You will help improve user experience by providing detailed feedback on a variety of content types.

Key responsibilities

• Review AI‑generated outputs and evaluate them for quality, clarity, usability, and overall user experience.
• Identify inconsistencies, weaknesses, and improvement opportunities across diverse content and visual formats.
• Apply structured evaluation guidelines and deliver nuanced feedback to inform model enhancements.
• Collaborate with cross‑functional teams to define and refine quality standards, scoring criteria, and review processes.
• Maintain high accuracy and consistency across evaluations to ensure reliable, actionable results.
• Contribute to the continuous improvement of evaluation workflows and best practices.

Required profile

• Native‑level English proficiency (C1/C2).
• Exceptional reading comprehension and acute attention to detail.
• Strong observational skills with excellent aesthetic or editorial judgment.
• Critical thinking ability to deliver consistent, high‑quality evaluations in ambiguous scenarios.
• Excellent written and verbal communication skills.

Required skills