[Hiring] Generalist Evaluator Expert REMOTE USA
Position: Generalist Evaluator Expert
Date Posted: March 25, 2026
Industry: Artificial Intelligence / Research / Writing
Employment Type: Freelance (Independent Contractor)
Experience: Not Specified
Qualification: Bachelor’s Degree (Completed or in progress) from a reputable institution
Salary: $35-$40 /hr (Competitive, based on project terms)
Location: United States or Canada (Remote)
Company: Mercor
Description:
Mercor is seeking detail-oriented and highly skilled writing experts to contribute to a high-impact artificial intelligence research initiative in collaboration with a leading AI lab. This role focuses on creating high-quality prompt and response pairs that are used to train and evaluate advanced language models.
This is a flexible, short-term opportunity designed for professionals who excel in writing, analytical thinking, and breaking down complex concepts into clear and structured content. The role is remote and project-based, allowing candidates to work independently while contributing to cutting-edge AI development.
In this position, you will play a key role in shaping how AI systems understand and respond to prompts by designing evaluation standards and assessing model outputs.
Key Responsibilities:
• Design and optimize detailed prompts with multiple instructions and constraints
• Develop comprehensive evaluation criteria and rubrics to assess response quality
• Test AI models by running prompts and evaluating their outputs against expected results
• Participate in quality assurance processes to ensure consistency and accuracy of prompts and evaluations
• Collaborate with the team to maintain high standards in benchmarking and evaluation tasks
• Contribute to structured workflows while working independently and meeting deadlines
Requirements:
• Bachelor’s degree (completed or in progress) from a recognized institution
• Strong writing, analytical, and critical thinking abilities
• Ability to work independently and manage time effectively
• Familiarity with AI tools such as ChatGPT or similar platforms
• Must be based in the United States or Canada
Preferred Qualifications:
• Experience in teaching, research, or academic writing
Project Details:
• Expected commitment of at least 20 hours per week
• Project duration of approximately 2 months
• Fully remote and flexible working schedule
• Structured environment with clear goals and tools
• Work may be extended, shortened, or concluded based on performance and project needs
Application & Onboarding Process:
• Complete an AI-led interview (approximately 15 minutes)
• Complete a 45-minute written assessment focused on rubric creation
• Selected candidates will be invited to join the project
Contract & Payment Terms:
• Independent contractor role
• Weekly payments via Stripe or Wise based on completed work
• Remote work with flexible scheduling
• No involvement with confidential or proprietary client information
• Open to all qualified applicants except H1-B or STEM OPT candidates
This is a unique opportunity to contribute to the development of advanced AI systems while working alongside leading researchers and being compensated for your expertise.
Disclaimer: The job details above are structured for clarity and based on publicly available content from recruiters/Company pages. All rights remain with the original source; names may be withheld for confidentiality. We are not involved in the hiring process.
