The approach records semantic state and checks candidate tool actions before effects are applied. Its decision is not simply whether a response looks suspicious; it tests whether the requested transition fits a known resource and authority model. The evaluation discusses both attacks blocked and legitimate task completion costs. The result is a paper…
Inspect the ClaimsCase · DiggingBeagle record
SecureGARD inserted an external semantic policy check before agent tools ran
Ontology-based runtime adjudication was evaluated as a defense against tool-action deviations.
Public disclosure: Nov 5, 2026
Experimental external authorization framework for tool-using language agents.
Assessment profile
Assessment method- Setting
- evaluation
- Exploitation
- not established
- Evidence
- Grade C
- Remediation
- not applicable
- AI role
- AGAINST AI
Basis and provenance
SecureGARD zero observed attack successes are author-measured benchmark outcomes under selected ontologies, not evidence of universal prevention or deployed enforcement. An impact band remains unassigned because the available evidence does not establish a comparable severity score or verified numerical loss for this assessment.
Assessed Nov 8, 2026 using diggingbeagle.assessment/1.
Evidence basis: CLM-SECUREGARD-EXTERNAL-EXECUTION-CHECK-01 · CLM-ENR-SECUREGARD-ASR-SCOPE · SecureGARD: dynamic ontology-guided governance
At a glance
An explicit external authorizer can reduce implicit trust in the model, but must be evaluated on legitimate task continuity as well as attack rejection.
Read the implicationsThe result is a paper evaluation, not an independently audited production guard. Unknown domain state, incomplete ontologies and benign task interruptions limit any claim of fail-safe prevention.
Limits and uncertaintyFull account
The approach records semantic state and checks candidate tool actions before effects are applied. Its decision is not simply whether a response looks suspicious; it tests whether the requested transition fits a known resource and authority model. The evaluation discusses both attacks blocked and legitimate task completion costs.
The result is a paper evaluation, not an independently audited production guard. Unknown domain state, incomplete ontologies and benign task interruptions limit any claim of fail-safe prevention.
The proposed guard evaluates the intended state transition at the action boundary, outside the language model's own explanation. Its ontology encodes permitted relationships and is updated offline, then frozen for the runtime evaluation. The authors report zero attack successes across their selected tasks and backbones, a measured sample result rather than evidence that every novel tool or incomplete ontology is covered. The crucial implementation question is what happens when the semantic state is missing or wrong, and whether benign work remains possible.
Mechanism and trust boundary
- 01
Construct semantic state and an authority ontology for the task.
- 02
Ask the policy layer to evaluate the agent-proposed action.
- 03
Allow or reject the effect based on the external state transition check.
Claims & evidence
CLM-ENR-SECUREGARD-ASR-SCOPEThe SecureGARD authors report an observed 0% attack success rate across their selected benchmark tasks and LLM backbones; this does not establish protection against untested actions or an incomplete ontology.supported
Basis: reported finding
- supportsSecureGARD: dynamic ontology-guided governanceprimary disclosure
Abstract; Main Results; Backbone Sensitivity
CLM-SECUREGARD-EXTERNAL-EXECUTION-CHECK-01SecureGARD proposes an ontology-guided external execution control that determines whether an agent’s requested tool action conforms to the current authorized semantic state.supported
Basis: reported finding
- supportsSecureGARD: dynamic ontology-guided governanceprimary disclosure
Method: Semantic Execution Modeling; Execution Boundary and Semantic Adjudication
Implications
An explicit external authorizer can reduce implicit trust in the model, but must be evaluated on legitimate task continuity as well as attack rejection.
Unknowns and contradictions
- The result is a paper evaluation, not an independently audited production guard. Unknown domain state, incomplete ontologies and benign task interruptions limit any claim of fail-safe prevention.
Sources and citation
Material revision history
- Nov 8, 2026 · Canonical change recorded · new in release · revision 229