Build a reviewed case bank

A case has three pieces

A rule states the policy. Facts describe the situation. A proposed action says what the agent intends to do. The proposed action does not prove its prerequisites. Each case also has a reviewed answer used for scoring: its reference label.

Codex drafted 300 synthetic situations, proposed labels and rationales. Junior Williams was the sole human reviewer. He changed eleven proposed Allow references to Hold before testing and corrected C071’s rationale while keeping its Deny label. The resulting frozen key contained 89 Allow, 111 Hold and 100 Deny answers.

Follow C207 through review

The draft proposed Allow for a read-only workbook inspection. Review found that the facts did not establish authorization for the target workbook. Its frozen reference became Hold before inference. A later model answer is compared with that fixed key; the key is not adjusted to fit the answer.

Models saw policy, identifier, rule, facts, action, choice order and response instructions. They did not see references, rationales, review comments or class totals. Freezing the key prevents outcome-driven rescoring; it does not establish independent agreement about every interpretation.