Microsoft's FORGE results show why finding a suspicious code path, validating a vulnerability and shipping a repair need separate accounting. In its October 7 report, Microsoft describes 140 assigned Windows CVEs from May through September and 155 internally validated open-source reports across 23 projects. Those totals represent different populations and…
Inspect the ClaimsCase · DiggingBeagle record
Microsoft FORGE reported AI-assisted vulnerability discovery with validation bottlenecks
Microsoft FORGE reports 140 assigned Windows CVEs from May to September 2026, together with 155 internally validated open-source vulnerability reports across 23 projects.
Vendor internal research program and dated public disclosure October 7, 2026; reported findings across May to September.
Assessment profile
Assessment method- Setting
- research demonstration
- Exploitation
- demonstrated
- AI role
- WITH AI
Basis and provenance
Microsoft reports a mixed vulnerability-research portfolio with successful crash demonstrations and several remediation stages. No single remediation state or real-world victim count describes the whole portfolio. Primary passages were inspected in this review, but the pinned contract supplies no grading rubric for A-D or the numeric impact bands; both remain ungraded. This is a source review, not an independent reproduction.
Assessed Oct 13, 2026 using diggingbeagle.assessment/1.
Evidence basis: CLM-R4-FORGE-LAB-1 · CLM-R4-FORGE-LAB-2 · CLM-R4-FORGE-LAB-3 · CLM-R4-FORGE-LAB-4 · Microsoft: Three lessons from frontier AI vulnerability research
At a glance
For AI vulnerability research the meaningful operational unit is a reproduced flaw progressing through review and remediation, rather than raw agent-generated alert volume.
Read the implicationsThe proportion of reports independently reproduced and fixed across all downstream versions is not fully public. Reported model cost omits failed candidates and human handling, so all-in cost per serviced fix is unknown. Maintainer acknowledgement or acceptance is not a uniform measure of released remediation; the 93-report subset must not be labeled 93…
Limits and uncertaintyFull account
Microsoft's FORGE results show why finding a suspicious code path, validating a vulnerability and shipping a repair need separate accounting. In its October 7 report, Microsoft describes 140 assigned Windows CVEs from May through September and 155 internally validated open-source reports across 23 projects. Those totals represent different populations and stages of review.
The workflow uses agents to identify candidates and develop reproductions, then relies on validation and reviewer feedback to distinguish genuine findings from failures and duplicates. Component teams and maintainers still determine acceptance and servicing. Of the 155 open-source reports, 93 across 14 projects or project families had documented maintainer acknowledgement or acceptance at publication. The 39 hackathon reports were already included in the 155. Neither acknowledgement nor an internal reproduction means a fixed version reached every downstream user.
The cost figures describe a narrower successful subset. Microsoft's measurement averages $3.61 in model cost and 21.5 minutes across 182 successful crash cases using GPT-5.5. It includes all attempts associated with those successful cases, while excluding initial screening, failed or filtered candidates, human investigation and patch preparation. Dividing those figures into a security team's budget would therefore omit substantial work.
The supported conclusion is that automated generation and validation can operate at useful scale in the reported program, while acceptance and remediation remain separate constraints. The report does not establish an all-in cost per serviced vulnerability, independent reproduction of the entire portfolio or a uniform fix state. Its contribution is evidence about an AI-assisted research process, not a count of organizations compromised by the resulting findings.
Mechanism and trust boundary
- 01
Candidate generation
MDASH uses agentic scanning and analysis to identify suspicious code locations.
Boundary: A generated report is a hypothesis requiring reachable behavior and security relevance.
- 02
Validation and review
Project-specific provers and reviewers establish reproducible findings and distinguish duplicates, failures and accepted reports.
Boundary: Internal validation and maintainer acknowledgement have different evidentiary status.
- 03
Servicing
Component teams repair and regression-test accepted findings before release.
Boundary: A reproduced flaw or acknowledged report does not by itself establish a shipped fix.
Timeline
- Oct 7, 2026disclosure
Public disclosure
Claims & evidence
CLM-R4-FORGE-LAB-1Microsoft FORGE reports 140 assigned Windows CVEs from May to September 2026, together with 155 internally validated open-source vulnerability reports across 23 projects.supported
Basis: reported finding
- supportsMicrosoft: Three lessons from frontier AI vulnerability researchprimary disclosure
Introduction and Open-source vulnerability reporting snapshot.
CLM-R4-FORGE-LAB-2The team reports an average of $3.61 model cost and 21.5 minutes for proof-of-crash generation on 182 successful examples, explicitly excluding initial scouting, filtered cases, human review and patch preparation.supported
Basis: reported finding
- supportsMicrosoft: Three lessons from frontier AI vulnerability researchprimary disclosure
Measured costs of automated validation.
CLM-R4-FORGE-LAB-3Of Microsoft's 155 internally validated open-source reports across 23 projects, 93 across 14 projects or project families had documented maintainer acknowledgement or acceptance at publication. The 39 hackathon reports were included in the 155, not an additional total.supported
Basis: reported finding
- supportsMicrosoft: Three lessons from frontier AI vulnerability researchprimary disclosure
Open-source vulnerability reporting snapshot; FORGE OSS Bug Hunt Party.
CLM-R4-FORGE-LAB-4Microsoft says the quoted $3.61 and 21.5-minute averages cover all attempts associated with 182 successful crash cases using GPT-5.5, while excluding initial screening, failed or filtered candidates, human investigation and patch preparation.supported
Basis: reported finding
- supportsMicrosoft: Three lessons from frontier AI vulnerability researchprimary disclosure
Measured costs of automated validation, paragraphs 1-3.
Implications
For AI vulnerability research the meaningful operational unit is a reproduced flaw progressing through review and remediation, rather than raw agent-generated alert volume.
Unknowns and contradictions
- The proportion of reports independently reproduced and fixed across all downstream versions is not fully public.
- Reported model cost omits failed candidates and human handling, so all-in cost per serviced fix is unknown.
- Maintainer acknowledgement or acceptance is not a uniform measure of released remediation; the 93-report subset must not be labeled 93 shipped fixes.
Sources and citation
Material revision history
- Oct 13, 2026 · Published version · first publication · revision 141