Case · DiggingBeagle record

Offline agent audits could not identify opposite later deployment outcomes

Post-Audit Mirage constructs safe and harmful lifecycles that expose identical verifier-visible traces, proving a limit on decisions made from those traces alone.

Assessment profile

Assessment method
Setting
evaluation
Exploitation
not established
Evidence
Grade C
Remediation
not applicable
AI role
WITH AI
Basis and provenance

Conditional theoretical construction and experimental benchmark, not real deployment harm. The impact band remains unknown: available evidence does not establish actual deployed victim outcomes or a comparable measured loss.

Assessed Oct 26, 2026 using diggingbeagle.assessment/1.

At a glance

Claims & evidence

CLM-CP20-POSTAUDIT-MIRAGEThe Post-Audit Mirage paper formalizes observational equivalence and an error/abstention tradeoff for post-deployment agent verification.supported

Basis: reported finding

Link to claim
CLM-CP20-ENRICH-POSTAUDIT-MIRAGEPost-Audit Mirage constructs safe and harmful deployment lifecycles with identical offline verifier evidence; its IdentifiedRangeMonitor may abstain when post-deployment harm observations cannot identify the difference.supported

Basis: reported finding

Link to claim

Unknowns and contradictions

  • The indistinguishability result is conditional on the audit observation model and the constructed environments, not proof that all offline agent evaluation is worthless.

Sources and citation

Material revision history

  1. Oct 26, 2026 · Canonical change recorded · new in release · revision 193