Long-running agents depend on context reduction to remain within model limits. A summary may retain the code task and current objective while dropping the rule that forbids a particular implementation method. Once the summary becomes the active working memory, later tool calls can lack the original condition that made an action unacceptable. A study of…
Inspect the ClaimsCase · DiggingBeagle record
Agent compaction discards process constraints ahead of task descriptions
An October 22 study finds that summarizing long agent contexts can omit anti-cheating and process restrictions even while preserving the requested work. Omission is measurable, but actual production policy violation is not shown.
A summary losing a rule is not itself evidence that the agent carried out a prohibited act. The quantitative result depends on the benchmark, exact compactor and subsequent instruction handling, which varied in the paper.
Assessment profile
Assessment method- Setting
- evaluation
- Exploitation
- demonstrated
- Evidence
- Grade B
- Remediation
- not applicable
- AI role
- AGAINST AI
Basis and provenance
Enrich update: CLM-ENRICH-20261027-08 cites SRC-2026-CP21-COMPACTION-DROPS-POLICY at Abstract, SWE-chat process rules versus task specifications. New evidence concerns the bounded reported mechanism, prerequisite or outcome; setting evaluation; exploit status demonstrated; remediation status not_applicable. No independently comparable impact scale, affected production population or universal exploit success measure was established, so the impact band remains null. Original Claims remain individually attributable and any observed incident or simulated result is distinguished in the narrative.
Assessed Oct 27, 2026 using diggingbeagle.assessment/1.
Evidence basis: CLM-ENRICH-20261027-08 · Paper: agent compaction disproportionately loses rules and policy constraints
At a glance
The safety issue is loss of provenance and restriction lifetime, not simply a decline in benchmark task accuracy.
Read the implicationsA summary losing a rule is not itself evidence that the agent carried out a prohibited act. The quantitative result depends on the benchmark, exact compactor and subsequent instruction handling, which varied in the paper.
Limits and uncertaintyFull account
Long-running agents depend on context reduction to remain within model limits. A summary may retain the code task and current objective while dropping the rule that forbids a particular implementation method. Once the summary becomes the active working memory, later tool calls can lack the original condition that made an action unacceptable.
A study of five context compaction strategies and three models reports disproportionate loss of process restrictions, including around one third of anti-cheating rules missing in first summaries in the authors tested settings. A summary losing a rule is not itself evidence that the agent carried out a prohibited act. The quantitative result depends on the benchmark, exact compactor and subsequent instruction handling, which varied in the paper.
Store hard constraints and authorization policy in an immutable external channel and check them again at tool dispatch; treat generated summaries as task history rather than permission grants. The safety issue is loss of provenance and restriction lifetime, not simply a decline in benchmark task accuracy. Primary evidence.
Additional evidence and trust boundary
Context compaction creates a second source of authority if its prose summary becomes the only surviving copy of constraints. An instruction that says what to build and a rule that says how it may be built must not have the same retention priority. Keep mandatory policies in immutable context or machine-checked effect gates; a successful benchmark artifact does not prove those policies were preserved. Supporting record.
Mechanism and trust boundary
- 01
Step
- 02
Step
- 03
Step
Timeline
- Oct 22, 2026disclosure
Public disclosure
Claims & evidence
CLM-ENRICH-20261027-08On real SWE-chat agent sessions the researchers found process and prohibition instructions were lost about six times as often as requirements describing what to build.supported
Basis: reported finding
- supportsPaper: agent compaction disproportionately loses rules and policy constraintsprimary disclosure
Abstract, SWE-chat process rules versus task specifications
CLM-CP21-COMPACTION-DROPS-POLICY-1A study of five context compaction strategies and three models reports disproportionate loss of process restrictions, including around one third of anti-cheating rules missing in first summaries in the authors tested settings.supported
Basis: reported finding
- supportsPaper: agent compaction disproportionately loses rules and policy constraintsprimary disclosure
Abstract; anti-cheating policy retention experiments; strategy comparison
Implications
The safety issue is loss of provenance and restriction lifetime, not simply a decline in benchmark task accuracy.
Controls and mitigations
- Store hard constraints and authorization policy in an immutable external channel and check them again at tool dispatch; treat generated summaries as task history rather than permission grants.
Unknowns and contradictions
- A summary losing a rule is not itself evidence that the agent carried out a prohibited act. The quantitative result depends on the benchmark, exact compactor and subsequent instruction handling, which varied in the paper.
Sources and citation
Material revision history
- Oct 27, 2026 · Canonical change recorded · new in release · revision 196