CSE Roadmap

Core tier · about 8 hours · 15 parts

Part 6 of 15 · 2 min read

What the example found

Recall and safety by policy, the write-gate comparison, and the forgetting experiment's four worlds.

How to read the policy table: each row is one of five ways to carry the past into a new session; columns are recall, the two safety questions, and average tokens spent.

Policy Recall (8 questions, 40 trials) Reports address correct Phone not leaked Mean tokens
none 0% 0% 100%* 0
transcript (600) 0% 0% 100%* 516
flat 50% 0% 0% 29
semantic 38% 100% 100% 29
typed 88% 100% 100% 39

* Nothing was recalled, so nothing leaked; this is not a success.

What to notice: flat's 0% on the phone-leak question is the direct cost of having no supersede or forget rule. A note-list policy cannot tell a current fact from a stale one, or a forgotten one from a live one, because to it every note looks the same.

How to read the write-gate table: each row is one of two gate policies run on the same twelve sessions.

Gate Where do reports go? Correct Proposals quarantined per world
open (any source may write) 0% 0
gated (only the user and the system may write) 100% 1

What to notice: ordinary recall is identical either way (88% in both rows). That is exactly why a write gate is cheap to adopt: it costs nothing on the common case and prevents the one case that matters.

How to read the forgetting table: each row is a different combination of where the number was stated and whether copies were scrubbed.

World Scrub copies? Number in the file before Number in the file after
ordinary line yes yes no
ordinary line no yes no
quoted in a summary yes yes no
quoted in a summary no yes yes

What to notice: the only failing row is the one where the number was quoted in a summary and scrubbing was switched off. The fact row itself was correctly deleted in every row. So a check that only looked at the facts table would have missed this exact failure.

{{svg:policies|The five policies on the same 50 questions. The bar is recall; the two labels are the safety questions.}} {{svg:gate|The write path with the gate. The gate decides on the source of the text, not on what it says.}}