Case · DiggingBeagle record

PROTEA robot hazard memory can over-report risks while tracking delayed effects

The PROTEA controlled robotics study uses persistent task and object-state context to flag delayed harms, but reports precision reductions for several judges. This is not evidence of an actual robot accident.

Scope

The source was published in January 2026 and resurfaced in October conference reporting. Demonstrations with toy objects and selected judges cannot be generalized to injury rates on deployed robots.

Assessment profile

Assessment method
Setting
evaluation
Exploitation
demonstrated
Evidence
Grade B
Remediation
not applicable
AI role
AGAINST AI
Basis and provenance

Enrich update: CLM-ENRICH-20261027-20 cites SRC-2026-CP21-MU-ROBOT-SAFETY-MEMORY at Abstract, security of task plans and malicious plan dataset. New evidence concerns the bounded reported mechanism, prerequisite or outcome; setting evaluation; exploit status demonstrated; remediation status not_applicable. No independently comparable impact scale, affected production population or universal exploit success measure was established, so the impact band remains null. Original Claims remain individually attributable and any observed incident or simulated result is distinguished in the narrative.

Assessed Oct 27, 2026 using diggingbeagle.assessment/1.

At a glance

Timeline

  1. Jan 12, 2026
    disclosure

    Public disclosure

Claims & evidence

CLM-ENRICH-20261027-20PROTEA tests LLM safety judgments on benign and malicious robot plans with harms inserted at different levels of stealthiness; its January 2026 public paper does not establish a rate of prevented real-world injuries.supported

Basis: reported finding

Link to claim
CLM-CP21-MU-ROBOT-SAFETY-MEMORY-1The PROTEA paper reports tracking object and task state across robotic actions to detect deferred hazards, while some evaluated LLM judges exhibit materially more false-positive alerts in its benchmark.supported

Basis: reported finding

Link to claim

Implications

Safety memory needs verifiable state updates. More retained context by itself does not guarantee better decisions.

Controls and mitigations

  • Use deterministic state constraints for known physical hazards and evaluate judge precision as well as recall across longer trajectories and changed objects.

Unknowns and contradictions

  • The source was published in January 2026 and resurfaced in October conference reporting. Demonstrations with toy objects and selected judges cannot be generalized to injury rates on deployed robots.

Sources and citation

Material revision history

  1. Oct 27, 2026 · Canonical change recorded · new in release · revision 196