In Osorio v. Kilmer, a plaintiff alleges that an investigator relied on an automated facial recognition candidate derived from bank surveillance imagery and portrayed the match as a personal identification without verifying it against independent evidence. The plaintiff was later able to supply an alibi and criminal charges were dismissed. The November 9…
Inspect the ClaimsCase · DiggingBeagle record
A court allowed a mistaken-arrest claim to proceed where an AI facial match allegedly replaced independent identification evidence
In Osorio v. Kilmer, a plaintiff alleges that an investigator relied on an automated facial recognition candidate derived from bank surveillance imagery and portrayed the match as a personal identification without verifying it against independent evidence. The plaintiff was later able to supply an alibi and criminal charges were dismissed.
Public disclosure: Nov 9, 2026
Law enforcement treats automated candidate identification from a partial image as evidence supporting an arrest and detention request.
At a glance
The asserted identity gains legal authority before independent evidence resolves whether the candidate is the same person, creating risk of unjustified detention.
Read the implicationsThe AI-relevant failure class is promoting a statistical similarity candidate into probable cause or human-verified identity without corroboration.
Limits and uncertaintyFull account
In Osorio v. Kilmer, a plaintiff alleges that an investigator relied on an automated facial recognition candidate derived from bank surveillance imagery and portrayed the match as a personal identification without verifying it against independent evidence. The plaintiff was later able to supply an alibi and criminal charges were dismissed.
The November 9 federal order permitted an amended claim and denied dismissal on qualified-immunity grounds at the pleading stage. The court analyzed the pleaded lack of corroboration; it did not conduct a final trial or make a finding that the software itself produced a false match as an established fact.
The machine score, vendor, investigator notes and exact evidence available at warrant issuance are not in the reviewed record. Allegations about police conduct remain allegations until tested in litigation.
The AI-relevant failure class is promoting a statistical similarity candidate into probable cause or human-verified identity without corroboration.
Mechanism and trust boundary
- 01
Starting condition
Law enforcement treats automated candidate identification from a partial image as evidence supporting an arrest and detention request.
Boundary: precondition and attacker capability
- 02
Trust boundary crossed or evaluated
The November 9 federal order permitted an amended claim and denied dismissal on qualified-immunity grounds at the pleading stage. The court analyzed the pleaded lack of corroboration; it did not conduct a final trial or make a finding that the software itself produced a false match as an established fact.
Boundary: mechanism
- 03
Observed consequence
The asserted identity gains legal authority before independent evidence resolves whether the candidate is the same person, creating risk of unjustified detention.
Boundary: observed effect and limitations
Claims & evidence
CLM-NOV15-OSORIO-MECHIn Osorio v. Kilmer, a plaintiff alleges that an investigator relied on an automated facial recognition candidate derived from bank surveillance imagery and portrayed the match as a personal identification without verifying it against independent evidence. The plaintiff was later able to supply an alibi and criminal charges were dismissed. The November 9 federal order permitted an amended claim and denied dismissal on qualified-immunity grounds at the pleading stage. The court analyzed the pleaded lack of corroboration; it did not conduct a final trial or make a finding that the software itself produced a false match as an established fact.supported
Basis: reported finding
- supportsOsorio v. Kilmer memorandum opinion regarding AI facial recognition leadgovernment record
Osorio v. Kilmer Filing 26, November 9 memorandum opinion, pleaded facts and qualified-immunity ruling
CLM-NOV15-OSORIO-SCOPEThe machine score, vendor, investigator notes and exact evidence available at warrant issuance are not in the reviewed record. Allegations about police conduct remain allegations until tested in litigation. The AI-relevant failure class is promoting a statistical similarity candidate into probable cause or human-verified identity without corroboration.supported
Basis: reported finding
- supportsOsorio v. Kilmer memorandum opinion regarding AI facial recognition leadgovernment record
Primary disclosure: results, scope and limitations
Implications
The asserted identity gains legal authority before independent evidence resolves whether the candidate is the same person, creating risk of unjustified detention.
Controls and mitigations
- Require independent, recorded corroboration before acting on a face-matching lead; log the original candidate, score, review and officer testimony separately.
- Maintain reviewable adverse-action evidence and disclose algorithm involvement to relevant judicial reviewers without treating a match as definitive identity.
Unknowns and contradictions
- The AI-relevant failure class is promoting a statistical similarity candidate into probable cause or human-verified identity without corroboration.
Sources and citation
Material revision history
- Nov 15, 2026 · Canonical change recorded · new in release · revision 250