Red Pen Jobs
Search roles

AI Safety Experts — English & Portuguese (global)

Listed pay: $29to 45 / hr

What the posting lists, in US dollars an hour, before anything Mercor deducts.

28 openings on this one listing.

How to apply
Platform
Mercor
Terms
Contract, part-time
Location
Remote, no country stated
Posted
· 1 month ago
Status
Open at the last check

Applying on Mercor

Apply on Mercor

If you're hired through a link here and start paid work, Mercor pays this site a referral fee. Your pay is unaffected.

Red Pen Jobs is independent. We are not affiliated with, endorsed by, or acting for Mercor in any way, and we do not recruit on its behalf.

What happens after you click

  1. The link opens this role on Mercor. Sign up and apply from there.
  2. Upload a resume, complete the assessments the role asks for and verify your work authorisation.
  3. An AI interview of about 20 minutes. Mercor says it usually takes 2 to 4 weeks to hear back.
  4. If Mercor hires you, you are paid weekly, on the Wednesday after each work week, via Stripe. Mercor says first payouts are held for 7 days.
  5. The work is paid by the hour, at the $29–45 this posting lists.
  6. Remote. The posting names no country, so we have not assumed one applies.

What the work is

Location: Remote

Fluent Language Skills Required: English & Portuguese (global, excluding Brazilian Portuguese). Native fluency in English and Portuguese (global, excluding Brazilian Portuguese) is required for this position.

Why This Role Exists

At Mercor, we believe the safest AI is the one that’s already been attacked — by us. We are assembling a red team for this project - human data experts who probe AI models with adversarial inputs, surface vulnerabilities, and generate the red team data that makes AI safer for our customers.

This project involves reviewing AI outputs that touch on sensitive topics such as bias, misinformation, or harmful behaviors. All work is text-based, and participation in higher-sensitivity projects is optional and supported by clear guidelines and wellness resources. Before being exposed to any content, the topics will be clearly communicated.

What You’ll Do

  • Red team conversational AI models and agents: jailbreaks, prompt injections, misuse cases, bias exploitation, multi-turn manipulation

  • Generate high-quality human data: annotate failures, classify vulnerabilities, and flag systemic risks

  • Apply structure: follow taxonomies, benchmarks, and playbooks to keep testing consistent

  • Document reproducibly: produce reports, datasets, and attack cases customers can act on

Who You Are

  • You bring prior red teaming experience (AI adversarial work, cybersecurity, socio-technical probing)

  • You’re curious and adversarial: you instinctively push systems to breaking points

  • You’re structured: you use frameworks or benchmarks, not just random hacks

  • You’re communicative: you explain risks clearly to technical and non-technical stakeholders

  • You’re adaptable: thrive on moving across projects and customers

Nice-to-Have Specialties

  • Adversarial ML: jailbreak datasets, prompt injection, RLHF/DPO attacks, model extraction

  • Cybersecurity: penetration testing, exploit development, reverse engineering

  • Socio-technical risk: harassment/disinfo probing, abuse analysis, conversational AI testing

  • Creative probing: psychology, acting, writing for unconventional adversarial thinking

What Success Looks Like

  • You uncover vulnerabilities automated tests miss

  • You deliver reproducible artifacts that strengthen customer AI systems

  • Evaluation coverage expands: more scenarios tested, fewer surprises in production

  • Mercor customers trust the safety of their AI because you’ve already probed it like an adversary

Why Join Mercor

  • Build experience in human data-driven AI red teaming at the frontier of safety

  • Play a direct role in making AI systems more robust, safe, and trustworthy

From the Mercor listing.