Part 6 of 15 · 2 min read
What the example found
Recall and safety by policy, the write-gate comparison, and the forgetting experiment's four worlds.
How to read the policy table: each row is one of five ways to carry the past into a new session; columns are recall, the two safety questions, and average tokens spent.
| Policy | Recall (8 questions, 40 trials) | Reports address correct | Phone not leaked | Mean tokens |
|---|---|---|---|---|
none |
0% | 0% | 100%* | 0 |
transcript (600) |
0% | 0% | 100%* | 516 |
flat |
50% | 0% | 0% | 29 |
semantic |
38% | 100% | 100% | 29 |
typed |
88% | 100% | 100% | 39 |
* Nothing was recalled, so nothing leaked; this is not a success.
What to notice: flat's 0% on the phone-leak question is the direct cost of having no supersede or forget rule. A note-list policy cannot tell a current fact from a stale one, or a forgotten one from a live one, because to it every note looks the same.
How to read the write-gate table: each row is one of two gate policies run on the same twelve sessions.
| Gate | Where do reports go? Correct | Proposals quarantined per world |
|---|---|---|
| open (any source may write) | 0% | 0 |
| gated (only the user and the system may write) | 100% | 1 |
What to notice: ordinary recall is identical either way (88% in both rows). That is exactly why a write gate is cheap to adopt: it costs nothing on the common case and prevents the one case that matters.
How to read the forgetting table: each row is a different combination of where the number was stated and whether copies were scrubbed.
| World | Scrub copies? | Number in the file before | Number in the file after |
|---|---|---|---|
| ordinary line | yes | yes | no |
| ordinary line | no | yes | no |
| quoted in a summary | yes | yes | no |
| quoted in a summary | no | yes | yes |
What to notice: the only failing row is the one where the number was quoted in a summary and scrubbing was switched off. The fact row itself was correctly deleted in every row. So a check that only looked at the facts table would have missed this exact failure.
{{svg:policies|The five policies on the same 50 questions. The bar is recall; the two labels are the safety questions.}} {{svg:gate|The write path with the gate. The gate decides on the source of the text, not on what it says.}}