Part 5 of 12 · 2 min read
Why an alias is a silent risk, and why in-flight runs need pinning
A moving name can change what it points to with no commit in your own repo at all.
Think of a shortcut on your desktop that points to "today's build" versus one that points to a specific, dated file. The first one can start opening a different program tomorrow without you ever touching your desktop.
In plain words: an alias like latest can start pointing at a different model snapshot overnight with nothing changing in your own repository, and a run that is already mid-flight when a version changes can end up mixing two different versions of behaviour within a single run unless it is pinned to the release it started on.
A worked example. When an alias silently moves to a new snapshot that changes behaviour on 15 percent of prompts, replay agreement on the same 500 requests drops from 95.6 percent to 84.4 percent — a real, measurable shift with no corresponding code change to point to. Separately, when a new prompt goes live while 200 runs are mid-flight at step 3 of 6: every one of the 200 unpinned runs ends up mixing two versions across its own steps; the 200 runs pinned to the release they started on mix zero.
The key lines.
# from code/mini-versioning/versioning.py
def inflight_mixing(n_runs=200, steps=6, switch_at_step=3, pinned=False):
mixed = 0
for _ in range(n_runs):
versions = ["r1" if pinned or s < switch_at_step else "r2" for s in range(steps)]
mixed += len(set(versions)) > 1
return mixed
Read it as: an unpinned run just asks "what's current right now" at every step, so it crosses the switch mid-run. A pinned run keeps using the release it started with, regardless of what has since been promoted.
Model snapshot, alias, pinning
A snapshot is a fixed, dated version of a model; an alias is a moving name that can point to different snapshots over time; pinning binds a run or request to one specific version for its whole lifetime.
Example: the 200 pinned runs above, none of which mixed versions, against the 200 unpinned runs, all of which did.