Red Pen Jobs
Search roles

Study Domain Expert — Judge Calibration — Sales

Listed pay: $90 / hr

What the posting lists, in US dollars an hour, before anything Mercor deducts.

10 openings on this one listing.

How to apply
Platform
Mercor
Terms
Contract, part-time
Location
Remote, no country stated
Posted
· 4 days ago
Status
Open at the last check

Applying on Mercor

Apply on Mercor

If you're hired through a link here and start paid work, Mercor pays this site a referral fee. Your pay is unaffected.

Red Pen Jobs is independent. We are not affiliated with, endorsed by, or acting for Mercor in any way, and we do not recruit on its behalf.

What happens after you click

  1. The link opens this role on Mercor. Sign up and apply from there.
  2. Upload a resume, complete the assessments the role asks for and verify your work authorisation.
  3. An AI interview of about 20 minutes. Mercor says it usually takes 2 to 4 weeks to hear back.
  4. If Mercor hires you, you are paid weekly, on the Wednesday after each work week, via Stripe. Mercor says first payouts are held for 7 days.
  5. The work is paid by the hour, at the $90 this posting lists.
  6. Remote. The posting names no country, so we have not assumed one applies.

What the work is

Role Overview

Mercor is sourcing Sales experts for a structured judge-calibration study. You will apply professional judgment to realistic Sales work and evaluate model-generated outputs.

What You'll Do

  • Sign an NDA before receiving study materials.

  • Complete one realistic Sales task using supplied source files.

  • Review model outputs, rank and score them, and write evidence-based rationales.

  • Provide structured feedback on the task and study design.

Time Commitment 13 hours during September 12–15, 2026.

Quality Criteria

  • More than 5 years of experience in Sales or a closely relevant field, ideally at a high-caliber firm.

  • Ideally held a manager, director, or principal-level Sales role; entry-level experience alone is insufficient.

  • Fluent or native English.

  • Prior work as an expert is a plus.

  • No geographic restrictions.

Study Conditions and Eligibility

  • No use of LLMs or other AI assistants during the study.

  • People who have worked on Project Alchemy in any capacity or accessed its source-world data are not eligible.

From the Mercor listing.

More roles for sales and CRM specialists

Every role we hold for sales and CRM specialists