A developer's October 13 public bug report recorded normal HTTP 200 responses from Perplexity's Decisions API while straightforward choice questions returned almost equal alternative probabilities. A strongly negative product review, for example, produced scores close to one third for positive, mixed and negative choices, with very low reported choice…
Inspect the ClaimsCase · DiggingBeagle record
Schema-valid Decisions API calls returned near-uniform, unusable choice confidences
A first-hand support report records Perplexity decisions on obvious known-answer prompts nearly collapsing to uniform options while HTTP requests still succeeded; provider acknowledged an issue and a later recovery.
Public Perplexity first-hand community support thread, October 13 2026; deterministic test prompts and provider replies.
Assessment profile
Assessment method- Setting
- production
- Exploitation
- observed live
- Evidence
- Grade C
- Remediation
- fixed reported
- AI role
- AGAINST AI
Basis and provenance
A public first-hand provider-forum thread contains repeated direct HTTP observations and a dated engineering acknowledgement followed by a reporter recovery message. The evidence supports a localized semantic regression in the reported API interactions. It does not establish a service-wide incident, root cause, downstream unsafe transactions or independently certified repair.
Assessed Oct 18, 2026 using diggingbeagle.assessment/1.
Evidence basis: CLM-CP13-DECISION-200 · CLM-CP13-DECISION-RESPONSE · CLM-ENRICH-DECISION-NO-SCOPE · Perplexity Decisions API returned near-uniform decisions, first-hand support thread
At a glance
A health endpoint, schema validator or HTTP status alone cannot reveal degraded semantic choice quality. A decision API can silently change downstream routing even when no requests fail. A fixed suite of known-answer sentinels can identify this class of regression, but such sentinels cannot replace task-specific authorization and calibration evaluation.
Read the implicationsRoot cause, actual degraded interval and affected request population unconfirmed. No independent harmed decision or financial impact demonstrated.
Limits and uncertaintyFull account
A developer's October 13 public bug report recorded normal HTTP 200 responses from Perplexity's Decisions API while straightforward choice questions returned almost equal alternative probabilities. A strongly negative product review, for example, produced scores close to one third for positive, mixed and negative choices, with very low reported choice confidence. The same tester repeated direct requests and compared versions, then reported that the provider investigated and the behavior later returned to normal.
This supports a concrete first-hand semantic regression report, not an independently measured service-wide outage. Neither the cause nor the population of affected production decisions is known, and there is no documented customer harm. HTTP success and valid JSON only show transport and schema health. They do not prove that a classification, routing or authorization decision is meaningful.
The useful operational question is how a downstream system identifies loss of discrimination while the API remains formally available. Known-answer sentinels, negative controls and task-specific calibration checks can expose regressions that uptime monitors miss. They cannot by themselves authorize a high-impact action or establish which infrastructure layer introduced the abnormal result.
Claims & evidence
CLM-CP13-DECISION-200The reporter recorded semantically near-uniform choices on straightforward queries despite successful HTTP status and expected response schema.supported
Basis: reported finding
- supportsPerplexity Decisions API returned near-uniform decisions, first-hand support threadprimary disclosure
First user report, exact product review choice scores and HTTP traces
CLM-CP13-DECISION-RESPONSEProvider engineers responded on October 13 and the original reporter later described recovery; precise root cause and global blast radius were not established.supported
Basis: reported finding
- supportsPerplexity Decisions API returned near-uniform decisions, first-hand support threadprimary disclosure
Provider response and final reporter recovery comment
CLM-ENRICH-DECISION-NO-SCOPERepeated well-formed API responses support the reporter's account of low-confidence decisions, but the public thread does not determine the number of affected customer requests or establish downstream losses.supported
Basis: reported finding
- supportsPerplexity Decisions API returned near-uniform decisions, first-hand support threadprimary disclosure
Perplexity community bug thread #6348, reporter direct HTTP examples and engineering replies
Implications
A health endpoint, schema validator or HTTP status alone cannot reveal degraded semantic choice quality. A decision API can silently change downstream routing even when no requests fail. A fixed suite of known-answer sentinels can identify this class of regression, but such sentinels cannot replace task-specific authorization and calibration evaluation.
Controls and mitigations
- Monitor stable known-answer and negative-control questions for ranking, confidence and expected probability separation independently from availability metrics.
- Fail closed or route to human review when a safety-critical choice model becomes semantically uninformative, while preserving outputs and provider responses for later root-cause comparison.
Unknowns and contradictions
- Root cause, actual degraded interval and affected request population unconfirmed.
- No independent harmed decision or financial impact demonstrated.
Sources and citation
Material revision history
- Oct 18, 2026 · Canonical change recorded · new in release · revision 171