Case · DiggingBeagle record

snapRAG extracted indexed knowledge from retrieval assistants under a controlled query budget

A retrieval-oriented extraction method reconstructed a large share of a synthetic or benchmark RAG corpus from model responses, illustrating that answer-level permissions may expose source collection content over repeated queries.

Public disclosure: Nov 9, 2026

Scope

Retrieval-augmented AI services where user queries are allowed to draw from a repository whose entire contents should not be disclosed through the user's effective authorization.

Assessment profile

Assessment method
Setting
evaluation
Exploitation
demonstrated
Evidence
Grade B
Remediation
not applicable
AI role
AGAINST AI
Basis and provenance

Desk assessment of cited firsthand report and scope limits; quantitative denominators describe only the reporter's stated sample. No independent live exploitation or universal impact is inferred.

Assessed Nov 11, 2026 using diggingbeagle.assessment/1.

At a glance

Mechanism and trust boundary

  1. 01

    Query a retrieval service repeatedly

    The adversary has query access, not raw source-database access.

    Boundary: question API / protected RAG index

  2. 02

    Assemble excerpts across responses

    Distinct queries induce retrieval of overlapping portions of indexed documents.

    Boundary: RAG output / aggregation process

  3. 03

    Infer substantial hidden corpus

    The collected snippets reconstruct material beyond what any single question exposed.

    Boundary: per-query authorization / collection-level confidentiality

Claims & evidence

CLM-ENR237-SNAPRAG-DEFENSE-RANGEThe snapRAG paper reports extraction rates between 50.7% and 96.3% across five defended benchmark targets and a maximum of 96.9% under a selected ordinary evaluation setup.supported

Basis: reported finding

Link to claim
CLM-R236-SNAPRAG-CORPUS-EXTRACTION-STUDY-01The snapRAG paper evaluates iterative reconstruction of hidden retrieval corpus content through allowed answer queries.supported

Basis: reported finding

Link to claim
CLM-R236-SNAPRAG-CORPUS-EXTRACTION-STUDY-02The paper reports up to 96.9% extraction in controlled conditions; it does not report a confirmed production customer compromise.supported

Basis: reported finding

Link to claim

Implications

A system can enforce per-answer retrieval yet still leak most of a corpus in aggregate if the caller is allowed to issue unbounded overlapping queries. Authority over an individual answer is not authority to export the collection.

Controls and mitigations

  • Bind retrieval results to the exact requesting principal's document ACLs before model context assembly.
  • Limit bulk extraction patterns at the retrieval layer, accounting for repeated semantically overlapping queries and aggregate output.
  • Audit source-chunk disclosure and citations as observable egress, not merely whether a model refuses an obvious download request.
  • Monitor repeated near-duplicate and frontier-search query patterns with corpus-aware budgets, but enforce document permission at each retrieval and avoid returning unnecessary raw source chunks.

Unknowns and contradictions

  • The reported maximum applies to benchmark conditions and cannot be extrapolated to all RAG products, document security models or query quotas. No real-world victim or actual customer dataset theft was demonstrated.

Sources and citation

Material revision history

  1. Nov 11, 2026 · Published version · first publication · revision 238