Evidence · DiggingBeagle record

MetaPI: Constructing Prompt Injection Benchmarks from LLM Agent Benchmark

Primary or origin disclosure used to qualify the underlying mechanism, stated prerequisites and limits. arXiv2611.10026: 150 sampled tasks AppWorld/VitaBench/Terminal; 183 attacks on107 tasks, 104 deflection/79 injection, 94 necessary read/89 incidental. Baseline ASR 50%,45.9%,44.4%. CaMeL AppWorld attack0% but utility33.7%; Terminal0% attack and0% utility => no reachable attacks. Some meta-align comparisons other backbone. Effective ASR differs net.

Source role
primary disclosure

Evidence record

Primary or origin disclosure used to qualify the underlying mechanism, stated prerequisites and limits. arXiv2611.10026: 150 sampled tasks AppWorld/VitaBench/Terminal; 183 attacks on107 tasks, 104 deflection/79 injection, 94 necessary read/89 incidental. Baseline ASR 50%,45.9%,44.4%. CaMeL AppWorld attack0% but utility33.7%; Terminal0% attack and0% utility => no reachable attacks. Some meta-align comparisons other backbone. Effective ASR differs net.

Read the original source ↗

Claim-level citations (3)