Scout22 › Jobs › Mercor › Member of Technical Staff, Enterprise Evals Platform

Member of Technical Staff, Enterprise Evals Platform

Mercor

Staff+On-siteSan Francisco, CA, USA

Want to shape how AI learns in real-world tasks?

Apply in one tap on the scout22 app — your details fill themselves in on every application Apply on Mercor's website fill out every field yourself, every time

Already have scout22? Open this job in the app

About Mercor

Mercor organizes human intelligence to power the AI economy.

What you'd do

Define golden sets for expert quality
Build calibrated verifiers for outputs
Run loss analysis over production
Own rollout gates for agent changes

What they're looking for

1–5 years in software engineering
Degree in Computer Science or related
Experience with LLM evaluation suites
Strong fundamentals in software engineering