CSE Roadmap

Common tier · about 3 hours · 12 parts

Part 2 of 12 · 2 min read

The release manifest: everything that can change behaviour, hashed together

One value that stands for the exact combination of code, prompt and model that served a request.

Think of a recipe card that lists not just the dish's name but every ingredient and its exact amount. Two cooks may hold cards with the same dish name but different amounts of salt. They will produce different meals. Both would still say they made "the same recipe."

In plain words: an agent's behaviour depends on far more than its code — the prompt text, the model snapshot, sampling settings, tool schemas, retrieval index and guardrails all matter — so a single hash of all of them together is the only way to know exactly which combination produced a given result.

A worked example. Changing any one of eight manifest fields changes its release id. Even something as small as an extra space in a prompt moves the id from 878347f787 to 3b31f86a1a — a completely different fingerprint for a one-character difference. A diff between two manifests lists only the fields that actually changed, so "what changed since yesterday?" becomes a direct lookup instead of a guess.

The key lines. From code/mini-versioning/versioning.py:

# from code/mini-versioning/versioning.py
@dataclass(frozen=True)
class Manifest:
    code_sha: str
    prompt: str
    model: str
    temperature: float = 0.0
    seed: int | None = None
    tools: tuple = ()
    index_version: str = "idx-1"
    guardrails: str = "g-1"

    def id(self): return h(asdict(self))

Read it as: every field that could change what the agent does lives in one frozen object, and the id is a hash of all of them together. The object is frozen so that a manifest is a value that gets published. It is never an object that gets edited in place.

Release manifest, release id

A release manifest is the complete list of components that determine an agent's behaviour; a release id is a content hash of that manifest.

Example: 878347f787 versus 3b31f86a1a — two release ids differing only because one prompt had an extra trailing space.