A tool can tell the truth yet omit the one fact that determines whether the next action is permitted. EpiSEM changes evidence completeness while keeping the remaining facts truthful, separating omission risk from instruction injection or fabricated data. An agent that treats missing restrictions as permission crosses an authorization boundary despite…
Inspect the ClaimsCase · DiggingBeagle record
Truthful but incomplete tool output changed agent authorization decisions
EpiSEM-Bench reports that omitting a safety-relevant fact from an otherwise truthful response increased unsafe tool execution in controlled agent tasks.
Assessment profile
Assessment method- Setting
- evaluation
- Exploitation
- not established
- Evidence
- Grade C
- Remediation
- not applicable
- AI role
- WITH AI
Basis and provenance
Controlled benchmark on simulated fact omission, without production compromise measurement. The impact band remains unknown: available evidence does not establish actual deployed victim outcomes or a comparable measured loss.
Assessed Oct 26, 2026 using diggingbeagle.assessment/1.
Evidence basis: CLM-CP20-EPISEM-MISSING-EVIDENCE · CLM-CP20-ENRICH-EPISEM-MISSING-EVIDENCE · EpiSEM truthful tool-output omissions cause unsafe agent execution
At a glance
Reported rates are for the paper’s paired environments and task-level success definitions. They are not an observed percentage of production agent compromises or proof of model-independent behavior.
Limits and uncertaintyFull account
A tool can tell the truth yet omit the one fact that determines whether the next action is permitted. EpiSEM changes evidence completeness while keeping the remaining facts truthful, separating omission risk from instruction injection or fabricated data. An agent that treats missing restrictions as permission crosses an authorization boundary despite consuming no explicitly malicious sentence. primary evidence presents a controlled benchmark of this failure.
Reported rates are for the paper’s paired environments and task-level success definitions. They are not an observed percentage of production agent compromises or proof of model-independent behavior.
Make missing safety predicates a reason to retrieve more evidence or abstain before the effect. An upstream search ranking or tool-output length cap can become security-relevant when it removes precisely those predicates.
EpiSEM-Bench varies what the tool leaves out rather than introducing a false or imperative sentence. It contains 300 matched unsafe/safe task pairs across six domains; ten models are then assessed for whether they execute prohibited actions, seek the omitted constraint, or abstain. Access to an independent evidence-recovery tool reduced unsafe execution across all ten models in the published experiments, but it did not make evidence recovery uniform. A useful system test omits one critical authorization fact while leaving every returned statement literally true, then measures both the rejected unsafe action and the correctly completed permitted counterpart.
Claims & evidence
CLM-CP20-EPISEM-MISSING-EVIDENCEThe EpiSEM-Bench authors evaluated 300 matched unsafe/safe task pairs and found material changes in unsafe task outcomes when safety-critical evidence was withheld.supported
Basis: reported finding
- supportsEpiSEM truthful tool-output omissions cause unsafe agent executionrole not specified
Abstract; benchmark construction; omission experiments
CLM-CP20-ENRICH-EPISEM-MISSING-EVIDENCEEpiSEM-Bench builds 300 matched unsafe/safe task pairs across six domains and reports that offering an independent evidence-recovery tool reduces unsafe execution for all ten evaluated models.supported
Basis: reported finding
- supportsEpiSEM truthful tool-output omissions cause unsafe agent executionrole not specified
Abstract; paired safe/unsafe worlds; six domains, ten models and independent recovery intervention
Unknowns and contradictions
- Reported rates are for the paper’s paired environments and task-level success definitions. They are not an observed percentage of production agent compromises or proof of model-independent behavior.
Sources and citation
Material revision history
- Oct 26, 2026 · Canonical change recorded · new in release · revision 193