Upfirst - [Deepgram API] Elevated Batch Error Rates: 400 error code responses – Incident details

All systems operational

[Deepgram API] Elevated Batch Error Rates: 400 error code responses

Resolved
Degraded performance
Started about 1 month agoLasted about 23 hours

Affected

Deepgram → Text to Speech API

Operational from 2:00 PM to 4:03 PM, Degraded performance from 4:03 PM to 4:34 PM, Operational from 4:34 PM to 1:08 PM

Updates
  • Resolved
    UTC
    Resolved

    This incident has been resolved.

  • Monitoring
    UTC
    Monitoring

    A fix has been implemented and traffic has returned to normal. We are monitoring the results.

  • Investigating
    UTC
    Investigating

    We are continuing to investigate an issue. STT batch requests may have returned 5xx errors, and some STT websockets may have experienced high latency, starting at 16:03 UTC.

  • Update
    UTC
    Update

    We are continuing to monitor for any further issues.

  • Monitoring
    UTC
    Monitoring

    A fix has been implemented and we are monitoring the results.

  • Update
    UTC
    Update

    We are continuing to investigate this issue.

  • Investigating
    UTC
    Investigating

    We are currently investigating an issue where some batch requests are returning 400 errors due to remote content download errors. Retrying the request one or more times often succeeds.