oilab replicate lever-is-lateGitHub →When should we believe a mech-interp claim?
An independent lab studying how LLM agents fail on long-horizon tasks — and what their internals do, and don’t, reveal. Ten papers on one model. Six of our own claims walked back.
We publish positives and nulls with the same rigor: pre-registered, every number recomputed from public data, permanent Zenodo DOIs. This is the WANDERING arc — from “agents that never finish” to “the authorization a model feels is not the one you granted.”
The action lags the answer.
The verbalizable “global workspace” reaches an agent’s tool commitment strictly deeper than its answer — a depth band steers the answer but not the action. Holds across a dense and an MoE model.
The lever is late.
In a long-horizon agent, knowledge consolidates ~30 layers before the action is committed. The knowledge–action gap is a depth gap.
Detect ≠ control.
A feature can predict a behavior at AUROC ≈ 1 and not cause it — even the exact feature, clamped at its own value.
Felt, not granted.
An internal authorization monitor inherits the model’s judgment error: it is blind to the realistic over-reach the agent makes in good faith.
Faithful only when it matters.
A reasoning model’s chain-of-thought is causal for its answer only when it changes the outcome — and that causal content lives in one late layer band, a readable monitoring locus.
One question, followed honestly for ten papers.
Why do capable LLM agents loop forever and never finish — and can their internals tell us, or change it? Each step links to its permanent record.
- 01
WANDERING
Long-horizon agents collapse into tool-call loops and never finish. A probe-free tool-entropy-collapse signal flags it — cross-architecture, cross-task.
10.5281/zenodo.20368807 - 02
It is finalization, not competence
A behavioral interruption rescues WANDERING finalization 30% → 70% (paired McNemar p = 0.021). The agent can finish; it fails to commit the ending.
10.5281/zenodo.20490286 - 03
Detect ≠ control
The clean "task complete" feature predicts the stop (AUROC 0.91) but clamping it does not cause the stop. Detection is not control — even at the exact, named feature.
10.5281/zenodo.20532769 - 04
The lever is late
Knowledge consolidates ~30 layers before the action is committed (L51–63, not the mid-layer verdict). The knowledge–action gap is a LAYER gap — the arc’s first positive causal lever.
10.5281/zenodo.20534219 - 05
It generalizes — and it brakes
The late lever generalizes across actions and architectures and works as a brake on irreversible actions (send / delete / drop / deploy): ~100% suppress-and-redirect where the agent commits.
10.5281/zenodo.20679287 - 06
The authorization direction
A single late-layer direction both detects AND controls an agent’s commitment to unauthorized irreversible actions — and replicates across architectures (Qwen3.6-27B, gpt-oss-20b).
10.5281/zenodo.20683623 - 07
Felt, not granted
But that direction reads the authorization the model FEELS, not the one the user GRANTED. On 21 realistic over-reaches it allows 100% (CI [0.845, 1.0]); an external task-grounded check catches all. Internal monitors inherit the model’s judgment error.
10.5281/zenodo.20685264 - 08
The late channel
The turn from control to audit. In a 27B reasoning agent, chain-of-thought is causal for the answer — and for the agent’s action — only when it changes the outcome; otherwise it is performative. That causal content consolidates in the same late band (L51–63), confirmed by a logit-lens control. The late state is a readable, causal locus for monitoring reasoning agents.
10.5281/zenodo.20752895 - 09
Located, not secured
The synthesis. Interpretability locates a real, causal control surface — the late action band — but does not secure it, via five orthogonal limits: detect ≠ control, felt ≠ granted, form ≠ granted, control ≠ robust control (the brake collapses under an adaptive white-box attack), and intervention is easy exactly where it is unneeded. Locating where behavior is decided is necessary but nowhere near sufficient for securing it. The implication: use interpretability to audit and monitor a fixed model, not to defend against an adversary optimizing against a known locus.
10.5281/zenodo.20764857 - 10
The criterion cannot see what it does not measure
Audit the TRANSFORMATION, not just the model. A SOTA capability-guided efficiency criterion (head-level attention hybridization) is structurally blind to the agent-commitment circuit: the commit writers score exactly zero retrieval criticality and the layer’s top retrieval heads are the circuit’s opposers. Applying the selection collapses task-appropriate commitment (p = 7.6e-6) — worse than random at equal budget — while the criterion’s own benchmarks register nothing. Two named heads (0.5% of budget) restore the behavior; the criterion could never have found them.
10.5281/zenodo.21175758 - 11
The action lags the answer
An agent’s tool commitment routes through the emergent verbalizable “global workspace” STRICTLY DEEPER than its answer. There is a depth band where steering the verbalizable direction reroutes a held answer but not the committed tool (at or below a magnitude-matched random-direction control); the action becomes steerable via the same direction only deeper. Replicates across a dense 27B and an MoE 20B — the absolute band is model-dependent, the answer→action depth lag is not. Ablating the verbalizable subspace leaves the commitment intact. A verbalizable monitor thus reads the answer a depth-band before the action is decided. Every positive dissociation is significant (Fisher exact, p from 1.5e-4 to 2.5e-18) and the causal counts are independently GPU-reproduced.
10.5281/zenodo.21250691
The discipline, not the marketing.
We publish our own nulls.
Six pre-registered walk-backs across the arc. A negative result, reported as a negative result, is the unit of progress.
Every number is recomputed.
Each paper ships an eval script that recomputes every figure from the public ledgers (35/35, 54/54, 88/88) plus a web-verified citation check.
Permanent + reproducible.
Zenodo DOIs, public GitHub, Hugging Face datasets, and one-command replication via openinterp-lab on the Colab CLI.
Depth over breadth.
One open-weights reasoning model (Qwen3.6-27B) studied deeply, with cross-architecture checks (gpt-oss-20b, Llama-3.1) where the claim is universal.
Caio Vicentino
Independent researcher · OpenInterpretability
- Accepted — ICML 2026 Mechanistic Interpretability Workshop (poster)
- NVIDIA Inception · AWS Activate
- 10 papers, permanent Zenodo DOIs, indexed on Google Scholar
Training & efficiency, in service of the same model.
The interpretability above runs on infrastructure we build and study in its own right.
Full-stack SAE training
11-layer sparse autoencoders on Qwen3.6-27B; the substrate for the probes above.
Mechanistic reward modeling
reward signals grounded in interpretable internal features, not surface text.
Sub-4-bit quantization
ternary / trit-plane post-training quantization for cheap open-weights inference.
Tools that came out of the research.
Released so others can reproduce and extend the work — not products, just the apparatus. Apache-2.0.
We extend frontier-lab interpretability infrastructure with an agent-trajectory + honest-negatives layer. See full lineage →
Read it, reproduce it, or build on it.
Every claim has a permanent DOI, a public ledger, and a one-command replication. Found a flaw? That is the point — tell us.