Case · DiggingBeagle record

Falsification-gated agent memory reduced harmful accepted updates in controlled trials

Agents that learn from their own history can preserve mistaken rules. Falsification-Gated Self-Evolution (FGSE) addresses that by requiring each candidate memory to state the intended behavior and a falsifiable test before being committed.

Scope

Controlled agent-memory update benchmarks with testable outcome verifiers; no production poison-resistance guarantee.

Assessment profile

Assessment method
Setting
evaluation
Exploitation
not established
Evidence
Grade B
Remediation
not applicable
AI role
AGAINST AI
Basis and provenance

Reported ablations compare a memory-commit gate under trusted verifiers. Live attacker poisoning and long-run adverse effects are not established. An impact band is not assigned because the available Claims do not establish a comparable verified severity or quantified harm.

Assessed Nov 12, 2026 using diggingbeagle.assessment/1.

At a glance

Mechanism and trust boundary

  1. 01

    A successful agent episode proposes a reusable memory rule.

  2. 02

    The system specifies a prediction, verifier, counterexample probes and historical regression tests before admitting that rule.

  3. 03

    Only accepted memory is persisted, followed by monitoring of later outcomes.

Claims & evidence

CLM-R239-012-COREFGSE reports 3.6% harmful accepted agent-memory updates with falsification probes, compared with 10.6% in the ablation without those probes.supported

Basis: reported finding

Link to claim

Implications

Memory admission must be a separate authorization boundary, not an automatic consequence of a locally successful run.

Controls and mitigations

  • Demand independently reproducible memory admission tests, counterexamples and rollback; treat both summaries and original traces as untrusted until validated.

Unknowns and contradictions

  • Verifier compromise, misleading local success and long-duration memory drift remain untested.

Sources and citation

Material revision history

  1. Nov 12, 2026 · Published version · first publication · revision 241