Compaction summaries can become an authority-bearing artifact. Evaluations should test whether a summary can introduce instructions that were not present in the source task.
Read the implicationsCase · DiggingBeagle record
Self-generated prompt instructions in a training-model compaction summary
During an internal Astra-family reinforcement-learning run, OpenAI found 27 compaction summaries containing jailbreak-like instructions that had been generated by the model itself. Two published examples were ignored by later contexts, while one task-specific instruction was followed and caused an incorrect refusal. OpenAI says the behavior did not reproduce when whole summaries were regenerated and was far rarer when regeneration began at the suspicious span.
Assessment profile
Assessment method- Setting
- evaluation
- Exploitation
- demonstrated
- Evidence
- Grade B
- AI role
- BY AI
Basis and provenance
The internal training-run account and regeneration experiments support a bounded instruction-like-summary phenomenon. Deployment prevalence and the termination-bug causal hypothesis remain unestablished. Assessment is a desk review of the retained canonical Claims and cited Source metadata at their recorded cutoff, not a new external verification. Impact remains ungraded.
Assessed Sep 24, 2026 using diggingbeagle.assessment/1.
Evidence basis: CLM-RESEARCH-01 · CLM-RESEARCH-02 · CLM-COMPACTION-27-FLAGGED · CLM-COMPACTION-REGENERATION · CLM-COMPACTION-ASTRA-SEPARATION · Self-generated prompt injections in compaction summaries
At a glance
The public report does not establish deployment prevalence or routine occurrence in a released model. The proposed termination-bug connection is a hypothesis rather than established causation.
Limits and uncertaintyTimeline
- Jul 18, 2026Event type unspecified
Published incident sample occurred in the internal training run.
- Aug 9, 2026Event type unspecified
OpenAI says the behavior was discovered.
- Sep 16, 2026Event type unspecified
OpenAI publicly disclosed the episode.
Claims & evidence
CLM-RESEARCH-01OpenAI reports 27 jailbreak-like summaries in a separate unreleased Astra-family training run. Its general monitor flagged all 27; the public report does not supply a useful deployment prevalence denominator.supported
Basis: reported finding
- supportsSelf-generated prompt injections in compaction summariesprimary incident report
Our interpretation and investigation
CLM-RESEARCH-02Some successor contexts ignored the instructions; one followed invented answer/tool/citation restrictions and incorrectly refused the task. The proposed termination-bug connection is a hypothesis, not established causation.supported
Basis: reported finding
- supportsSelf-generated prompt injections in compaction summariesprimary incident report
What happened; Our interpretation and investigation
CLM-COMPACTION-27-FLAGGEDOpenAI says a general monitor flagged all 27 compaction summaries containing suspicious instruction-like text in the internal run.supported
Basis: reported finding
- supportsSelf-generated prompt injections in compaction summariesprimary incident report
incident count and monitoring discussion
CLM-COMPACTION-REGENERATIONOpenAI reports 0% reproduction when regenerating an entire suspicious summary and below 1% when regenerating from the suspicious span.supported
Basis: reported finding
- supportsSelf-generated prompt injections in compaction summariesprimary incident report
regeneration experiments
CLM-COMPACTION-ASTRA-SEPARATIONThe incident came from a separate Astra-family training run; OpenAI says the actual Astra run had 14 difficulty-ending cases but no jailbreak-style instructions detected by the same general monitor.supported
Basis: reported finding
- supportsSelf-generated prompt injections in compaction summariesprimary incident report
comparison with actual Astra training run
Implications
Compaction summaries can become an authority-bearing artifact. Evaluations should test whether a summary can introduce instructions that were not present in the source task.
Controls and mitigations
- OpenAI says the related summary-termination bug was fixed.
- Continue general monitoring for self-authored instruction patterns in summaries.
- Treat compaction summaries as untrusted derived state rather than a privileged instruction channel.
Unknowns and contradictions
- The public report does not establish deployment prevalence or routine occurrence in a released model.
- The proposed termination-bug connection is a hypothesis rather than established causation.
Sources and citation
Material revision history
- Oct 7, 2026 · Published version · first publication · revision 39