CSE Roadmap

Core tier · about 4 hours · 12 parts

Part 9 of 12 · 2 min read

Mistakes that make a gate decorative

Common mistakes, and what the example does not do.

Mistakes that make a gate decorative

  • Approving every step, which trains rubber-stamping.
  • Gating by prompt only, so the gate can be argued away.
  • Blocking a worker thread while a person decides.
  • Default-approve on timeout.
  • Resuming without re-checking the premise.
  • Vague requests ("Proceed?") that force the person to investigate.
  • No audit trail, or approvals not tied to the exact arguments that run.
  • Approving one action, executing another (changed arguments after approval).
  • Never measuring approval rate, edits or sampled misses.

What the example does not do

About this example What the example does not do
  • No real reviewer, and the fatigue formula is an assumption.
  • Independent actions and independent reviews; real harm clusters.
  • No "edit" outcome: a reviewer can only approve or reject here.
  • A fixed, informative risk score; an adversary can manipulate it.
  • One reviewer and one worker; queues, shifts and escalation chains are not modelled.
  • No interface effects: the quality of the request screen changes real catch rates.
  • Optional real experiment: show 100 recorded agent actions, 10 of them harmful, to reviewers in two conditions (all actions, or only flagged ones) and compare the harm caught, time per decision and approval rate.

Check yourself

You ask a person to approve every one of six actions in each task. Is that safer than approving only the irreversible ones?

Show answer

Not necessarily. Attention is a resource the gate spends: in the model, gating everything caught 23 percent of harm because the reviewer was swamped. With a reviewer who never tires the order reverses.

For the curious The default on timeout

With a 30-minute mean wait and a 60-minute timeout, 13.5 percent of approvals time out. The default must be stop or re-plan, never approve, and the premise must be re-checked on resume. A worker that waits for each answer took 1,663 minutes for 50 tasks, against 272 when the run is saved and the worker takes other work.

What you will use daily at work

Practice What it looks like
Gate by consequence Read-only never needs approval; irreversible or costly always does.
Show what will happen The person approves an action they can see, not a vague summary.
Measure the gate Approval rate, time to decide, and harm found in sampled auto-approved actions.