Part 8 of 10 · 1 min read
Quick notes
- Retrieval-based memory keeps memories outside the window and, before each call, selects the few that are relevant. The two operations are write and recall.
- A retrieval score blends relevance, recency and importance, and the weights are design choices, not constants of nature.
- Similarity alone cannot tell which of two similar memories is current; the fix is write-time supersession on a key, not a better embedding. Increasing k only adds neighbours.
- Recency alone misses the old, important fact, and heavy recency weighting hurts once supersession exists.
- Who may write is a retrieval concern too: a tool result that writes under the user's key supersedes the user's fact unless a trusted-source gate stops it.