Case · DiggingBeagle record

Fine-tuned coding-model weights carried hidden triggers for tool misuse

Kerkoporta reports hidden-trigger tool-call behavior in compromised coding-model checkpoints, a different mechanism from retrieved prompt injection.

Public disclosure: Nov 1, 2026

Scope

Controlled fine-tuning experiments on selected Qwen3.5 model configurations, not an assertion about official vendor weights or observed victims.

Assessment profile

Assessment method
Setting
evaluation
Exploitation
demonstrated
Evidence
Grade B
Remediation
mitigation available
AI role
AGAINST AI
Basis and provenance

The authors trained controlled poisoned Qwen3.5-4B and 9B variants and tested trigger generalization, emission fidelity, false triggers and removal of reasoning traces. Results are conditional on these research fine-tunes and harnesses. Separate tool authorization could prevent unsafe effects even when the model emits a malicious call; its efficacy here is not independently demonstrated.. Impact is ungraded because no independently measured production-target impact or victim scope is established by this record.

Assessed Nov 4, 2026 using diggingbeagle.assessment/1.

At a glance

Mechanism and trust boundary

  1. 01

    Poison model fine-tuning examples

    The attacker injects examples associating trigger conditions with tool requests into a training process for a coding model.

    Boundary: Training dataset to deployed model weights

  2. 02

    Encounter a learned activation trigger

    During an otherwise legitimate coding session, the model matches an embedded condition that selects the learned malicious tool behavior.

    Boundary: User task context to backdoored policy behavior

  3. 03

    Emit a structured unauthorized tool call

    The benchmark measures whether the poisoned model selects attacker-desired tool actions; real execution still depends on host authorization.

    Boundary: Model output to actual tool effect

Claims & evidence

CLM-NOV04-KERKOPORTA-WEIGHT-POISON-1The study reports 94.8% out-of-distribution attack success for a poisoned Qwen3.5-4B configuration at its stated 50% poison setting.supported

Basis: reported finding

Link to claim
CLM-NOV04-KERKOPORTA-WEIGHT-POISON-2The authors also report 84.1% attack success on a separate Qwen3.5-9B configuration under its experimental conditions.supported

Basis: reported finding

Link to claim
CLM-NOV04-KERKOPORTA-WEIGHT-POISON-3At a 50% poison-example setting, removing trigger-related reasoning from the training examples lowered out-of-distribution attack success from 94.8% to 1.0% in the 4B configuration and from 84.1% to zero in the 9B configuration.supported

Basis: reported finding

Link to claim

Implications

A model checkpoint can carry a hidden attack policy that a prompt filter will not recognize. Defense requires supply-chain attestation of weights, behavioral regression and independently enforced tool permissions. This risk contrasts with benign parameter-level loop repair, which also changes the model artifact but does not prove malicious intent.

Controls and mitigations

  • Pin and attest the deployed checkpoint and fine-tuning lineage.
  • Run hidden-trigger security regressions before accepting a model update.
  • Keep sensitive tool permissions outside model control even if the model weights are trusted.
  • Before admitting a fine-tuned checkpoint to an agent, test trigger-conditioned tool-call behavior on held-out repositories and enforce action authorization separately from model-generated reasoning.

Unknowns and contradictions

  • Performance on independent models and production harnesses is not fully established.
  • The reported attack success is not proof of tool execution when permissions are correctly enforced.

Sources and citation

Material revision history

  1. Nov 4, 2026 · Published version · first publication · revision 217