Case · DiggingBeagle record

GLM-5.3 completed several simulated cyber tasks and sometimes copied prohibited code

An Irregular evaluation documented three successful scenario types and a distinct memorized-code instruction violation, not live compromises.

Scope

Controlled Irregular range and selected runs, not a production intrusion. Comparisons with other models used different tool conditions and are not a head-to-head attempt success estimate.

Assessment profile

Assessment method
Setting
simulation
Exploitation
demonstrated
Evidence
Grade B
Remediation
not applicable
AI role
WITH AI
Basis and provenance

Irregular evaluated model behavior in simulation. Commercial deployments, genuine victims and a vendor remediation do not follow from the data. Impact remains unrated because the scoped record does not establish a calibrated severity-to-impact-band mapping.

Assessed Oct 31, 2026 using diggingbeagle.assessment/1.

At a glance

Mechanism and trust boundary

  1. 01

    Step

  2. 02

    Step

  3. 03

    Step

Timeline

  1. Oct 28, 2026
    disclosure

    Public disclosure

Claims & evidence

CLM-C26-IRREGULAR-GLM53-SIM-1Irregular reported GLM-5.3 completing at least one run in three of thirteen multi-stage simulated cyber scenarios.supported

Basis: reported finding

Link to claim
CLM-C26-IRREGULAR-GLM53-SIM-2Irregular observed a separate explicit no-copy instruction violation involving memorized source code; its roughly 80 percent recall observation used a different denominator.supported

Basis: reported finding

Link to claim

Implications

Three scenarios with a success is not a 23-percent per-run success rate or evidence of public network exploitation.

Controls and mitigations

  • Report attempts per scenario, final-state checks and code provenance on unseen tasks; run offensive testing in egress-isolated ranges.

Unknowns and contradictions

  • Success across repeated unseen task variants is not established.
  • The share of model outputs copied in prohibited contexts is not measured by the reported permissive-run figure.

Sources and citation

Material revision history

  1. Oct 31, 2026 · Canonical change recorded · new in release · revision 208