Red Pen Jobs

QA / Software Engineering Reviewer – Browser Test Validation

Listed pay: $30to 60 / hr

What the posting lists, in US dollars an hour, before anything Mercor deducts.

13 openings on this one listing.

How to apply
Platform
Mercor
Terms
Contract, part-time
Location
Remote, no country stated
Posted
· 1 month ago
Status
Open at the last check

Applying on Mercor

Apply on Mercor

If you're hired through a link here and start paid work, Mercor pays this site a referral fee. Your pay is unaffected.

Red Pen Jobs is independent. We are not affiliated with, endorsed by, or acting for Mercor in any way, and we do not recruit on its behalf.

What happens after you click

  1. The link opens this role on Mercor. Sign up and apply from there.
  2. Upload a resume, complete the assessments the role asks for and verify your work authorisation.
  3. An AI interview of about 20 minutes. Mercor says it usually takes 2 to 4 weeks to hear back.
  4. If Mercor hires you, you are paid weekly, on the Wednesday after each work week, via Stripe. Mercor says first payouts are held for 7 days.
  5. The work is paid by the hour, at the $30–60 this posting lists.
  6. Remote. The posting names no country, so we have not assumed one applies.

What the work is

We're seeking experienced Software Engineers, QA Engineers, SDETs, and Test Automation Engineers to review browser-based evaluation workflows for AI-generated web applications. You'll validate whether browser tests are technically sound, deterministic, and capable of producing clear pass/fail outcomes before they become part of benchmark datasets.

What You'll Do

  • Review browser-based testing workflows for AI-generated web applications.

  • Assess whether browser interactions are technically feasible and reliable.

  • Validate test isolation, fixtures, setup, and execution flow.

  • Ensure assertions produce deterministic, unambiguous pass/fail results.

  • Identify flaky tests, hidden dependencies, or ambiguous validation logic.

  • Provide structured technical feedback following project review rubrics.

We're Looking For

  • 3+ years of experience in Software Engineering, QA Engineering, SDET, or Test Automation.

  • Strong experience testing modern web applications.

  • Familiarity with browser automation frameworks such as Playwright, Cypress, Selenium, or similar tools.

  • Experience writing automated UI and end-to-end tests.

  • Strong understanding of test isolation, fixtures, reproducibility, and reliable browser automation.

  • Excellent debugging skills and attention to detail.

Why Join?

  • Contribute to the development of AI systems by ensuring browser-based evaluation workflows are technically robust and reliable.

  • Review realistic web application testing scenarios involving automation, test design, and software quality engineering.

  • Collaborate with a high-calibre team helping establish quality standards for AI-generated software evaluation.

From the Mercor listing.

More roles for software engineers

Every role we hold for software engineers