Open to principal-scope roles · Phoenix, Arizona · Remote or hybrid
Learn AI · On the map · Agents · idea 31 of 44
Testing an AI system against a fixed set of cases so you know whether a change made it better or worse.

In one line
Testing an AI system against a fixed set of cases so you know whether a change made it better or worse.
Picture it
A driving test. Not 'did it feel fine,' but a set course, scored the same way every time.
Under the hood
A case set with expected outcomes, scored automatically where possible (groundedness, correctness, cost), run on every prompt, model or tool change. Without it, every improvement is an anecdote.
Builds on
On a guided path
Path 5: Running it safely, stop 11 of 11.
Marking "I get this" is self-reported and stays in this browser. The same mark shows on the map.