Part 4 of 13 · 2 min read
A scratchpad only remembers what looked important when it was written
Notes taken in the moment can only flag what seemed worth flagging in the moment.
Think of jotting down the headline of a news article as you read it, then needing a quote from the third paragraph a week later. Your notes have the headline, not the quote, because nobody knew at the time that the quote would matter.
In plain words: a scratchpad is a file of working notes the agent writes as it goes, always present in the window because it stays small. But it is lossy by construction, since whatever wasn't flagged as important at write time simply isn't there. That is a different and narrower failure than an offloaded file, which keeps everything and can be searched later for anything.
A worked example. Using notes alone (no offloaded files) across the twelve-output task, the agent answers 100% of the two questions about a value it had flagged, and 0% of the three questions about an unflagged detail -- a reference code nobody thought to write down at step 2 that turns out to matter at step 12. Overall this scores 50% correct for about 1,053 tokens. Offloading the same outputs to files, searchable later with grep, answers all of them (100%) for about 2,556 tokens -- roughly 2,500 more tokens, in exchange for the detail no one flagged in advance.
The key lines. From code/mini-workspace/agent.py:
# from code/mini-workspace/agent.py
elif strategy == "notes_only":
ws.append(notes_path, f"step {o.step}: {flagged_line(o)}") # the output itself is discarded; only the flagged line is kept
Read it as: the comment states the trade-off directly: "the output itself is discarded." Once a step's raw text is gone, no later question can recover anything from it except what this one line captured. That is the structural reason a scratchpad can never substitute for keeping the underlying data somewhere.
Scratchpad
A scratchpad is a file (or state object) where the agent writes working notes: findings, progress, intermediate results. It is always in the window, so it must stay small, and it cannot answer a question about anything that wasn't flagged when it was written.
Example: notes-only answering 0% of the unflagged-detail questions, against 100% for offloading, is the scratchpad's one limitation made numeric -- not a bug to fix, but the reason notes and offloaded files solve different problems and are usually both needed.