Scout22 › Jobs › Simile › Evaluations - Member of Technical Staff

Evaluations - Member of Technical Staff

Simile

$200k–$400kStaff+San Francisco, CA, USA

Ever wanted to shape how we understand human behavior?

Apply in one tap on the scout22 app — your details fill themselves in on every application Apply on Simile's website fill out every field yourself, every time

Already have scout22? Open this job in the app

About Simile

Simile simulates human behavior to inform critical decisions.

What you'd do

Design evals, metrics, and dashboards
Evaluate model versions and improve them
Develop ways to compare simulated responses

What they're looking for

Strong intuition for meaningful evals
Understanding of LLM basics and evaluation
Comfort with noisy data and statistical noise