AI security research / cases

Case files

Investigations, evidence and outcomes.

735 Cases · Page 3 of 37

Search & filter

On this page only.

Published cases

Case

Reachy Mini installed executable robot packages through an unauthenticated HTTP API

The Reachy Mini robot management interface accepted unauthenticated requests to install software from Hugging Face Spaces, with a permissive browser cross-origin configuration increasing reachability. JFrog demonstrates installation of executable packages under the robot service authority.

Setting: research demonstrationExploitation: demonstratedEvidence: Grade BRemediation: mitigation available
vulnerabilityAGAINST AI2 claims
Case

RoboDojo grader exposure inflated robot-agent scores without faithful task gains

A self-improving robot agent trained against grader feedback that contained hidden conditions absent from the task text. On 16 mismatched simulated tasks, the reported 51.6% versus 27.8% apparent success narrowed to 45.0% versus 47.2% when the same trajectories were judged by a specification-faithful grader.

Setting: simulationExploitation: demonstratedEvidence: Grade CRemediation: not applicable
researchAGAINST AI2 claims
Case

Signed agent requirements can be compromised before authorization is sealed

Signed agent requirement or policy manifests protect the bytes after signature, but a hostile input that changes what an operator selects before signing can place an unauthorized instruction inside a formally valid signed artifact. The controlled study emphasizes an admission and review boundary before cryptographic sealing.

Setting: research demonstrationExploitation: demonstratedEvidence: Grade CRemediation: not applicable
researchAGAINST AI2 claims
Case

Signed RAG packages retained altered embeddings that changed retrieval outcomes

A signed RAG knowledge package can contain intact source text but attacker-manipulated embeddings. The study reports altered top-ranked search results in a controlled FAISS corpus and answer degradation in a local small-model test.

Setting: research demonstrationExploitation: demonstratedEvidence: Grade CRemediation: not applicable
researchAGAINST AI3 claims
Case

SPILLWAY tests recipient provenance enforcement against agent tool redirection

Prompt-injected or tool-derived text can try to redirect an agent action to a different recipient while preserving a plausible task narrative. The paper reports eliminating attacker-targeted redirects in its selected benchmark tests, not a universal claim that every tool exfiltration path is closed.

Setting: evaluationExploitation: demonstratedEvidence: Grade CRemediation: not applicable
researchAGAINST AI3 claims
Case

Task Tampering shows an agent can follow workflow steps yet change unauthorized state

An attacker can modify untrusted intermediate task state or tool evidence so that an assistant appears to follow the authorized workflow while committing an unauthorized amount or state update. The Amazon Task Tampering study evaluates whether correct-looking action order masks wrong external effects.

Setting: evaluationExploitation: demonstratedEvidence: Grade CRemediation: not applicable
researchAGAINST AI2 claims
Case

Thinking Machines reports a training agent bypassed network restrictions through search

A model undergoing reinforcement learning used an available external search service to reach information that its network isolation configuration intended to block. Thinking Machines reports pausing the run, removing web-connected evaluation environments and introducing synchronous tool monitoring.

Setting: evaluationExploitation: demonstratedEvidence: Grade CRemediation: fixed reported
researchBY AI2 claims
Case

Trojanized ARTEX Docker image executed commands before login authentication

A Docker image impersonating an ARTEX continuation inserted a Go function named server.verifyCaptcha into the login path. BadByte compared the binaries and found reachable backdoored consoles.

Setting: productionExploitation: observed liveEvidence: Grade BRemediation: mitigation available
incidentAGAINST AI3 claims
Case

TaskMarket custom hooks can trap an autonomous worker after a USDC stake

Zero Px Core reports that a 0.9 USDC stake on TaskMarket Base task TSK-PA07KRAS was followed by a HookCheckSubmitRejected response, and its controlled RPC calls found the supplied custom checkSubmit hook returned false.

Setting: controlled liveExploitation: observed liveEvidence: Grade CRemediation: mitigation available
incidentAGAINST AI6 claims