10 to the 23 AI logo
Stephen Lieberman
Through 1023AI

Practice Library

Governance patternstructural

Cross-model verification

An independent second model across the first's outputs — correlated errors surface as disagreement instead of repeating silently across every case.

What it changes

amplifiedModels cross-check each other's outputs(ensemble disagreement surfaces correlated errors)
dampenedFailures relayed between AI models or agents(relayed output is checked before the next system consumes it)
increasedOperator deference drift(deference load — two systems agreeing reads as proof)

Who can pull it

Harness builderDeveloperDeploying organizationVendor

What it looks like institutionally

A single model's errors are correlated by construction: the same flaw fires on every case that matches it, so mistakes arrive at caseload scale rather than as scattered noise — the mechanism behind the documented automated-benefits failures, where one logic pattern produced tens of thousands of simultaneous wrongful determinations. Human review catches some of this; a genuinely independent second model catches a different slice, because its blind spots are differently placed.

Cross-model verification runs the second model across the first's outputs and treats disagreement as signal: agreements pass, disagreements route to a human. The word doing the work is "independent" — a second instance of the same model, or a second model fine-tuned from the same base, inherits the same blind spots and checks almost nothing. Diversity of vendor, architecture, and training data is what buys de-correlation, and current model-to-model research shows behavior and misalignment can propagate through shared context, so the checking channel itself needs the same provenance discipline as any other pathway.

Two costs are structural, not incidental. First, the deference cost: two systems agreeing reads as proof, and reliance rises on the pair beyond what either earned — the automation-bias literature's finding with a second signature on it. Pair this lever with deskilling arrest and track override rates. Second, the environmental cost: every checked output is inferred twice, making this the compute-heaviest checker in the catalog — the exogenous-cost ledger the framework keeps ("governance is not free") prices it accordingly, and a deployment stacking automated checkers can blow through its oversight-footprint target while the failure rate falls.

Addresses: Correlated model error (monoculture) · Silent agent-to-agent relay of errors. Test a version of this lever in the PAN Lab.

Deciding whether this lever fits your deployment?

Which patterns matter — and in what order — depends on your system's actual shape. Ranking your options on evidence, with what can backfire stated, is engagement work.

Sources & Evidence

Claims made on this page and what supports them. The full registry lives in Evidence.

EmpiricalA single automated rule set applied uniformly and without human review produced tens of thousands of correlate…

A single automated rule set applied uniformly and without human review produced tens of thousands of correlated wrongful fraud determinations in the documented Michigan MiDAS case — one flaw repeating at caseload scale rather than averaging out.

EmpiricalModel behavior — including misaligned behavior — can propagate through model-to-model channels: research shows…

Model behavior — including misaligned behavior — can propagate through model-to-model channels: research shows narrow in-context examples and inter-model interaction can induce broadly misaligned behavior in the receiving model.

afonin2026Academic

Afonin, N., Andriianov, N., Hovhannisyan, V., Bageshpura, N., Liu, K., Zhu, K., Dev, S., Panda, A., Rogov, O., Tutubalina, E., Panchenko, A., & Seleznyov, M. (2026). Emergent misalignment via in-context learning: Narrow in-context examples can produce broadly misaligned LLMs [Preprint]. arXiv. https://doi.org/10.48550/arXiv.2510.11288

doi.org/10.48550/arXiv.2510.11288

Appears in: 1023AI authored research

Topics: ai-alignment, complexity-science

panpatil2025Academic

Panpatil, S., Dingeto, H., & Park, H. (2025). Eliciting and analyzing emergent misalignment in state-of-the-art large language models [Preprint]. arXiv. https://doi.org/10.48550/arXiv.2508.04196

doi.org/10.48550/arXiv.2508.04196

Appears in: 1023AI authored research

Topics: ai-alignment, complexity-science