Begin with the basics
No AI, statistics or programming background needed. Each lesson explains one idea, works through an example and lets you try it. Check your understanding when you want to; you can always move forward.
What you will learn
- How permission differs from the ability to perform an action.
- How the study counts correct, incorrect and incomplete responses.
- What response time and reported certainty can tell you.
- How to read the results, cases and limitations together.
The examples run in this website. Change an input, inspect the result and reset it whenever you want. Your last lesson is saved in this browser when storage is available.
Follow the paper
- 01
Meet models and agents
Explain how a model becomes part of a system that can act.
- 02
What is the paper asking?
Explain the research question without assuming a universal winner.
- 03
Ideas behind the experiment
Distinguish authorization, selective classification and calibration.
- 04
Allow, Hold or Deny
Apply the policy in the correct order.
- 05
Build a reviewed case bank
Identify model inputs and the reference used to score them.
- 06
What counts as a response?
Separate decision validity, distribution validity and full compliance.
- 07
Accuracy and uncertainty
Compute accuracy with the right denominator and interpret uncertainty.
- 08
What does the clock measure?
Distinguish one response from a scored loop and an entire session.
- 09
Understand reported certainty
Distinguish a selected-answer probability from demonstrated correctness.
- 10
Different errors, different effects
Classify the hypothetical effect of an incorrect decision.
- 11
How the experiment was run
Identify shared controls and remaining configuration differences.
- 12
Read the accuracy results
Explain why coverage and class-level results matter beside accuracy.
- 13
Agreement can hide shared errors
Reconcile agreement, disagreements and the net accuracy difference.
- 14
A confident answer can be wrong
Read probability metrics with their eligibility sets and limits.
- 15
Compare speed and consequences
Interpret measured response times and explore illustrative error weights.
- 16
What the evidence cannot show
Explain the major limits without changing the recorded results.
- 17
State the conclusion responsibly
Connect the findings to evidence, authorship and ethics.
- 18
Inspect cases and connect the ideas
Use the complete case details and pinned evidence to explain a result.
Original research and reference material
The original paper remains unchanged. Explanations and teaching examples are companion additions. Reported values were checked against the public evidence deposit; new derivations are identified where they appear.
Model key. CLM: local Contrastive-LM; JEV: hosted TypeSafe; KEV: local Kev-4B; GLM: hosted GLM 5.3 FlashX. Full experimental configurations
The study classifies written situations against a frozen reviewed key. It does not execute actions or establish deployment safety. There is no general winner across the tested configurations.
