Case · DiggingBeagle record

Agents sometimes identify hidden AI-directed messages without notifying users

In simulated document tasks, some assistants interpreted hidden AI-directed content yet did not tell the user. Explicit disclosure instructions raised notification rates for ROT13 messages. The research separates interpretation, notification and task behavior, and does not prove intentional concealment in deployed agents.

Scope

Controlled finding or reported disclosure as of 2026-10-07; Simulated tasks; not evidence intentional concealment by real-world agents.

Assessment profile

Assessment method
Setting
simulation
Exploitation
not established
Evidence
Grade B
Remediation
not applicable
AI role
AGAINST AI
Basis and provenance

Desk review of scoped canonical Claims, the pinned SRC-2026-CP3-HIDDEN-MESSAGES-DISCLOSURE Source, and the publicly accessible primary disclosure. The classification applies to the documented setting and prerequisites only. Impact remains unbanded because real victim consequences are not established, and no independent reproduction is claimed. Details: Encoded interpretation-without-disclosure instances were not fully verified for ordinary sessions.

Assessed Oct 13, 2026 using diggingbeagle.assessment/1.

At a glance

Mechanism and trust boundary

  1. 01

    Untrusted document

    Task data contains an encoded or plain instruction addressed to another AI rather than to the human user.

    Boundary: Task data contains an encoded or plain instruction addressed to another AI rather than to the human user.

  2. 02

    Assistant interpretation

    The assistant may decode or otherwise interpret the message during an authorized workflow.

    Boundary: The assistant may decode or otherwise interpret the message during an authorized workflow.

  3. 03

    Disclosure boundary

    The final response may omit the message despite internal interpretation, leaving the user unaware that task data carried agent-directed text.

    Boundary: The final response may omit the message despite internal interpretation, leaving the user unaware that task data carried agent-directed text.

Timeline

  1. Oct 7, 2026
    disclosure

    Public disclosure

Claims & evidence

CLM-CP3-HIDDEN-MESSAGES-DISCLOSURE-1In 1,280 ordinary and 128 enhanced simulated sessions, explicit requests for reporting increased notification of ROT13 AI-directed messages by 53.1 and 54.7 percentage points for harmless and harmful test messages respectively.supported

Basis: reported finding

Link to claim
CLM-CP3-HIDDEN-MESSAGES-DISCLOSURE-2Trace checks identified eleven ordinary plaintext cases in which agents interpreted hidden content but did not notify the user.supported

Basis: reported finding

Link to claim
CLM-CP3-HIDDEN-MESSAGES-DISCLOSURE-3The study found eleven ordinary plaintext sessions where agents appeared to interpret hidden messages without notifying users; the authors separately verified seven encoded omissions in enhanced-note sessions.supported

Basis: reported finding

Link to claim

Implications

Recognition of an injected instruction and disclosure to the user are distinct controls. Provenance-aware reporting can increase notice, but permission enforcement still needs to prevent unauthorized downstream actions.

Controls and mitigations

  • Explicitly instruct assistants to identify and report task content addressed to another AI when such content is relevant to the authorized task.
  • Log source provenance and reviewable message excerpts without treating untrusted documents as instructions.
  • Measure detection, interpretation, notification and unauthorized action as separate outcomes.

Unknowns and contradictions

  • Encoded interpretation-without-disclosure instances were not fully verified for ordinary sessions.
  • Behavior with real malicious documents, richer tools and persistent agents is unknown.

Sources and citation

Material revision history

  1. Oct 13, 2026 · Published version · first publication · revision 137