About the role
Educator/Assessor Writer
Role Type: Contractor Location: Remote
Job Summary
We are looking for Educator/Assessor Writers to support an AI evaluation project focused on assessing and improving AI-generated content. You will apply your expertise in education, assessment, academic writing, grading, and rubric-based evaluation to review written responses.
No prior AI experience is required.
This role is ideal for professionals experienced in evaluating written work, developing assessments, grading against rubrics, or supporting academic writing. The engagement is fully remote and can be completed alongside other professional commitments.
Key Responsibilities
* Evaluate and compare AI-generated responses for clarity, accuracy, tone, helpfulness, and adherence to instructions. * Assess responses using provided rubrics, guidelines, and evaluation criteria. * Assign quality scores and provide clear, well-reasoned rationales. * Identify unsupported claims, inaccuracies, inconsistencies, and content gaps. * Evaluate whether responses are appropriate and practical for their intended audience. * Document evaluation decisions and observations accurately. * Collaborate asynchronously with project managers and reviewers using digital content review platforms. * Maintain consistency and objectivity across assigned evaluations.
Required Qualifications
* Native or near-native written fluency in English. * Degree from an accredited institution in the United States, Canada, United Kingdom, Ireland, Australia, or New Zealand. * Experience grading, marking, or evaluating written work against established criteria or rubrics. * Background in assessment design, instructional design, academic writing, peer review, or thesis supervision. * Strong critical-analysis and written communication skills. * Excellent attention to detail and ability to make objective assessments. * Ability to work independently and meet project deadlines.
Preferred Skills
* Experience with AI model evaluation or data annotation. * Familiarity with RLHF or AI training workflows. * Experience using digital assessment or content review platforms. * Strong understanding of educational assessment and rubric design.
Originally posted on Himalayas