Case · DiggingBeagle record

METR estimates faster Anthropic capability growth with uncertain AI causation

METR researchers worked within Anthropic from August to October 2026, comparing internal model capability growth against an earlier baseline. METR estimated roughly 1.9 times the prior AECI growth rate, with a broad uncertainty interval.

Public disclosure: Nov 5, 2026

Scope

Controlled empirical evaluation; percentages and effects apply to the reported task populations and conditions, not deployed incidents.

Assessment profile

Assessment method
Setting
evaluation
Exploitation
not established
Evidence
Grade B
Remediation
not applicable
AI role
WITH AI
Basis and provenance

evaluation; not established. The cited primary disclosure supports the specific sequence and boundaries described here: METR researchers work inside Anthropic under expanded access from August 12 to October 29, 2026. The evidence does not independently establish consequences beyond the record's supported outcome; a numerical impact band cannot be justified from the available evidence. Evidence grade B reflects the source attribution and independent verification limits.

Assessed Nov 7, 2026 using diggingbeagle.assessment/1.

At a glance

Mechanism and trust boundary

  1. 01

    METR researchers work inside Anthropic under expanded access from August 12 to October 29, 2026.

  2. 02

    They compare internal capability-index trajectories against a March 2024 to October 2025 historical baseline and interview R&D staff about AI use.

  3. 03

    The public report separates observed index trends from uncertain causal attribution and states that substantial informative evidence was redacted before publication.

Claims & evidence

CLM-DB07-122-OUTCOMEMETR estimated roughly 1.9 times the prior AECI growth rate, with a broad uncertainty interval. Its estimate that AI explains perhaps 80% of the acceleration is a subjective attribution rather than isolated causal measurement, and part of the most informative evidence was redacted.supported

Basis: reported finding

Link to claim
CLM-DB07-122-MECHANISMMETR researchers worked within Anthropic from August to October 2026, comparing internal model capability growth against an earlier baseline. Their internal AECI time series suggested accelerated progress, while staff reported extensive use of AI assistants in development.supported

Basis: reported finding

Link to claim
CLM-ENR-DB07-036-METR-UNCERTAINTY-INTERVALMETR reported approximately 1.9-fold faster AECI growth after October 2025 with a 95% uncertainty interval of roughly 1.5 to 2.8. The frequently quoted 80% share attributed to AI-assisted development was a subjective assessment, not a controlled causal experiment.supported

Basis: reported finding

Link to claim

Implications

Avoid conflating model-capability progress rate, developer self-reported productivity and causal impact of AI tooling; separately examine missing evidence and safety-versus-capabilities measurement coverage.

Unknowns and contradictions

  • Private data and publication redactions limit independent reproduction; model assistance not proven fully autonomous recursive improvement.

Sources and citation

Material revision history

  1. Nov 7, 2026 · Published version · first publication · revision 227