Analysis · DiggingBeagle record
How an instruction survives after its original message loses authority
Carryover, AutoRedClaw, shared-memory experiments and compaction laundering examine different ways low-trust content gains authority in a later turn. Their success rates apply to different steps and cannot be pooled.
- Published
- Oct 23, 2026
Overview
A malicious instruction can remain effective after its original webpage, tool response or conversation has disappeared from view. The persistence itself is not the whole attack. A later system must retrieve or summarize the content, treat it as sufficiently authoritative, and then use a tool or disclose information because of it. Recent experiments make those transitions separately measurable.
Two ways lower-trust text becomes a higher-trust instruction
CarryoverBench begins with planting: an attacker influences persistent files, memory or a scheduled heartbeat so the instruction will appear again. It then measures activation during a later task. The researchers' 101 attacks across twelve scenarios include immediate, autonomous and latent channels. Their finding of persistence across five follow-up rounds is conditional on successful planting and the study's scripted environment; it does not mean any random attack survives five production sessions.
Compaction Laundering studies a different transition. A forged approval enters through a tool response, then a summarizer flattens role-labeled exchanges into ordinary text. At the tested component boundary, five role-flattening harnesses laundered 13 to 15 of 15 trials, while four role-typed implementations laundered none. The experiment did not mean those nine complete products all made unauthorized payments: the authors evaluated captured serialization and summarization paths, then examined downstream execution in smaller, separate tests.
Both mechanisms are forms of context privilege escalation, but the protections attach at different points. A memory write needs durable provenance and revocation; a summary needs authenticated role origin rather than a bare assertion that "the user approved." A role-typed serializer is not an automatic cure for a malicious instruction already authorized by some other path.
A repository issue can become a short-lived version of the same problem
The Copilot hidden-comment investigation places instructions in Markdown that the agent reads but the assigning user may not see in rendered form. This attack need not persist for days. The relevant promotion occurs when issue data influences privileged agent tools, and subsequent CI or cloud escalation requires separate permissions. The same provenance question appears at the entry boundary rather than only after a memory write.
An end-to-end test should preserve four observations: the untrusted origin; the stored or summarized representation; the later authority decision; and the exact side effect, if any. The studies support that layered measurement. Counting every planted entry as a completed compromise would not.