<?xml version="1.0" encoding="UTF-8"?>
<feed xml:lang="en-US" xmlns="http://www.w3.org/2005/Atom">
  <id>tag:status.upfirst.ai,2005:/history</id>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai"/>
  <link rel="self" type="application/atom+xml" href="https://status.upfirst.ai/history.atom"/>
  <title>Upfirst Status - Incident history</title>
  <updated>2026-07-27T18:06:39.536+00:00</updated>
  <author>
    <name>Upfirst</name>
  </author>
  
<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cms3pfu7y02wd13ojlwt5t699</id>
  <published>2026-07-27T18:06:39.536+00:00</published>
  <updated>2026-07-27T20:52:18.772+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cms3pfu7y02wd13ojlwt5t699"/>
  <title>We’re seeing elevated latency, timeouts, and interrupted streaming across gpt 5.1 mini model and gpt 4.1 mini</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 6 days, 21 hours and 39 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API</p>
    <p><small>Jul <var data-var='date'> 27</var>, <var data-var='time'>20:52:18</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cms0b399p0cmu1mln0kgnldi7</id>
  <published>2026-07-25T11:35:24.966+00:00</published>
  <updated>2026-07-25T11:46:39.610+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cms0b399p0cmu1mln0kgnldi7"/>
  <title>Elevated error rates</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 21 hours and 37 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API, OpenAI → Realtime API</p>
    <p><small>Jul <var data-var='date'> 25</var>, <var data-var='time'>11:46:39</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>Jul <var data-var='date'> 25</var>, <var data-var='time'>11:57:02</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cms07c8sd08mt0klnnd8n02ii</id>
  <published>2026-07-25T09:17:49.024+00:00</published>
  <updated>2026-07-25T10:02:52.846+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cms07c8sd08mt0klnnd8n02ii"/>
  <title>Elevated error rates</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 4 days, 14 hours and 47 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API, OpenAI → Realtime API</p>
    <p><small>Jul <var data-var='date'> 25</var>, <var data-var='time'>10:02:52</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>Jul <var data-var='date'> 25</var>, <var data-var='time'>11:08:36</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmrxp52az00j00zqsl298dddp</id>
  <published>2026-07-23T15:36:02.973+00:00</published>
  <updated>2026-07-23T17:36:32.393+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmrxp52az00j00zqsl298dddp"/>
  <title>Elevated Error Rates</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 10 days, 21 hours and 19 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API, OpenAI → Realtime API</p>
    <p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>17:36:32</var> GMT+0</small><br /><strong>Identified</strong> -
  We are continuing to work on implementing a mitigation..</p>
<p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>17:53:36</var> GMT+0</small><br /><strong>Identified</strong> -
  We have identified that users are experiencing elevated errors for the impacted services.

We are working on implementing a mitigation..</p>
<p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>17:58:26</var> GMT+0</small><br /><strong>Identified</strong> -
  We are continuing to work on implementing a mitigation..</p>
<p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>18:50:34</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>19:37:21</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are investigating the issue for the listed services..</p>
<p><small>Jul <var data-var='date'> 24</var>, <var data-var='time'>10:06:05</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are investigating the issue for the listed services..</p>
<p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>20:22:48</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>Jul <var data-var='date'> 24</var>, <var data-var='time'>19:33:22</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>
<p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>15:56:57</var> GMT+0</small><br /><strong>Identified</strong> -
  We have identified that users are experiencing elevated errors for the impacted services.

We are working on implementing a mitigation..</p>
<p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>16:08:37</var> GMT+0</small><br /><strong>Identified</strong> -
  We have identified that users are experiencing elevated errors for the impacted services.

We are working on implementing a mitigation..</p>
<p><small>Jul <var data-var='date'> 23</var>, <var data-var='time'>16:48:54</var> GMT+0</small><br /><strong>Identified</strong> -
  We have identified that users are experiencing elevated errors for the impacted services.

We are working on implementing a mitigation with the downstream infrastructure provider..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmqudmohb042b2iny8jof7r6z</id>
  <published>2026-06-25T15:20:00.000+00:00</published>
  <updated>2026-06-25T16:41:00.000+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmqudmohb042b2iny8jof7r6z"/>
  <title>Google SSO auth doesn&#039;t work</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 day, 1 hour and 21 minutes</p>
    <p><strong>Affected Components:</strong> Web App</p>
    <p><small>Jun <var data-var='date'> 25</var>, <var data-var='time'>16:41:00</var> GMT+0</small><br /><strong>Resolved</strong> -
  This incident has been resolved..</p>
<p><small>Jun <var data-var='date'> 25</var>, <var data-var='time'>15:20:00</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are currently investigating this incident..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmqtin9xr00a02ipbyyfc403q</id>
  <published>2026-06-23T13:28:00.000+00:00</published>
  <updated>2026-06-23T13:28:00.000+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmqtin9xr00a02ipbyyfc403q"/>
  <title>The call list is not loading</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 day, 23 hours and 50 minutes</p>
    <p><strong>Affected Components:</strong> Web App</p>
    <p><small>Jun <var data-var='date'> 23</var>, <var data-var='time'>13:28:00</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are currently investigating this incident..</p>
<p><small>Jun <var data-var='date'> 23</var>, <var data-var='time'>15:18:00</var> GMT+0</small><br /><strong>Resolved</strong> -
  This incident has been resolved..</p>
<p><small>Jun <var data-var='date'> 23</var>, <var data-var='time'>15:00:00</var> GMT+0</small><br /><strong>Identified</strong> -
  We are continuing to work on a fix for this incident..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zjdvk01ik0znrojy0iyrh</id>
  <published>2026-05-28T11:53:00.000+00:00</published>
  <updated>2026-05-28T11:53:00.000+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zjdvk01ik0znrojy0iyrh"/>
  <title>Small number of Eleven V3 TTS generations returning 429s on the Global Residency Server</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 17 hours</p>
    <p><strong>Affected Components:</strong> ElevenLabs → Text to Speech API</p>
    <p><small>May <var data-var='date'> 28</var>, <var data-var='time'>11:53:00</var> GMT+0</small><br /><strong>Identified</strong> -
  We recently identified an issue where a smaller number of Eleven V3 TTS generations were returning 429s on the global residency server. This affected users on lower priority tiers. The service has since been fully restored and is operating normally..</p>
<p><small>May <var data-var='date'> 28</var>, <var data-var='time'>12:10:00</var> GMT+0</small><br /><strong>Resolved</strong> -
  The incident was resolved..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zlern01jj0znrp4dfs139</id>
  <published>2026-05-27T14:47:02.293+00:00</published>
  <updated>2026-05-27T14:47:02.293+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zlern01jj0znrp4dfs139"/>
  <title>Elevated Latency and Errors on API</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 6 days, 1 hour and 53 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API</p>
    <p><small>May <var data-var='date'> 27</var>, <var data-var='time'>14:47:02</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are investigating the issue for the listed services..</p>
<p><small>May <var data-var='date'> 27</var>, <var data-var='time'>15:21:59</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are investigating the issue for the listed services..</p>
<p><small>May <var data-var='date'> 27</var>, <var data-var='time'>15:45:05</var> GMT+0</small><br /><strong>Identified</strong> -
  We are still implementing the mitigation..</p>
<p><small>May <var data-var='date'> 27</var>, <var data-var='time'>15:59:22</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>May <var data-var='date'> 27</var>, <var data-var='time'>17:12:55</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>
<p><small>May <var data-var='date'> 27</var>, <var data-var='time'>17:54:42</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have received additional reports of elevated latency and errors after our previous recovery update. Mitigation remains in place, and we are monitoring recovery while we validate the remaining impact..</p>
<p><small>May <var data-var='date'> 27</var>, <var data-var='time'>20:06:53</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zjdvk01ij0znrl9sj29mr</id>
  <published>2026-05-25T09:47:35.033+00:00</published>
  <updated>2026-05-25T09:02:00.000+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zjdvk01ij0znrl9sj29mr"/>
  <title>Intermittent 500 Errors in Text-to-Speech (TTS) Generation</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 12 hours and 35 minutes</p>
    <p><strong>Affected Components:</strong> ElevenLabs → Text to Speech API</p>
    <p><small>May <var data-var='date'> 25</var>, <var data-var='time'>09:02:00</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We are currently investigating an issue affecting TTS, where some generations are failing with a 500 error..</p>
<p><small>May <var data-var='date'> 25</var>, <var data-var='time'>09:35:00</var> GMT+0</small><br /><strong>Resolved</strong> -
  The issue affecting Text-to-Speech (TTS) generation, which was causing intermittent 500 errors, has been resolved. The service is now operating normally..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmqtj0i1600jq2knziinhwsu7</id>
  <published>2026-05-22T21:00:01.824+00:00</published>
  <updated>2026-05-22T21:00:01.871+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmqtj0i1600jq2knziinhwsu7"/>
  <title>Outbound networking issues affecting STT, TTS streaming and batch service</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    
    <p><strong>Affected Components:</strong> Deepgram → Text to Speech API</p>
    <p><small>May <var data-var='date'> 22</var>, <var data-var='time'>21:00:01</var> GMT+0</small><br /><strong>Resolved</strong> -
  Some API requests may have experienced elevated error rates for approximately 2-3 minutes starting at 16:43 UTC on May 22, 2026. The issue has been resolved now..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zletr01jl0znrus78agw2</id>
  <published>2026-05-19T23:32:19.885+00:00</published>
  <updated>2026-05-20T00:37:42.319+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zletr01jl0znrus78agw2"/>
  <title>API users may see increased error rates for GPT-5.4 and GPT-5.5</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 2 days, 17 hours and 22 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API</p>
    <p><small>May <var data-var='date'> 20</var>, <var data-var='time'>00:37:42</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>
<p><small>May <var data-var='date'> 19</var>, <var data-var='time'>23:32:19</var> GMT+0</small><br /><strong>Identified</strong> -
  We have identified that users are experiencing elevated errors for the impacted services.

We are working on implementing a mitigation..</p>
<p><small>May <var data-var='date'> 19</var>, <var data-var='time'>23:38:09</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>May <var data-var='date'> 19</var>, <var data-var='time'>23:59:03</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zjdta01ih0znrukc3us7n</id>
  <published>2026-05-15T09:12:36.949+00:00</published>
  <updated>2026-05-15T09:12:36.000+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zjdta01ih0znrukc3us7n"/>
  <title>EU Residency - Issue with the Agents platform, TTS and Scribe in the EU residency server</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 day, 6 hours and 14 minutes</p>
    <p><strong>Affected Components:</strong> ElevenLabs → Text to Speech API</p>
    <p><small>May <var data-var='date'> 15</var>, <var data-var='time'>09:12:36</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are currently investigating an issue with the Agents platform, TTS and Scribe in the EU residency server..</p>
<p><small>May <var data-var='date'> 15</var>, <var data-var='time'>09:30:13</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have released an update, and the error rate is back to normal. We are currently monitoring the situation..</p>
<p><small>May <var data-var='date'> 15</var>, <var data-var='time'>09:42:51</var> GMT+0</small><br /><strong>Resolved</strong> -
  The issue has been resolved. We will publish a public write-up on this status page once the investigation is completed..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zleqc01jh0znrwhbhlyke</id>
  <published>2026-05-11T17:02:24.928+00:00</published>
  <updated>2026-05-11T16:11:00.000+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zleqc01jh0znrwhbhlyke"/>
  <title>Elevated error rates with GPT 5.5</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 2 days, 8 hours and 35 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API</p>
    <p><small>May <var data-var='date'> 11</var>, <var data-var='time'>16:11:00</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are investigating the issue for the listed services..</p>
<p><small>May <var data-var='date'> 11</var>, <var data-var='time'>16:35:00</var> GMT+0</small><br /><strong>Identified</strong> -
  We have identified that users are experiencing elevated errors for the impacted services.

We are working on implementing a mitigation..</p>
<p><small>May <var data-var='date'> 11</var>, <var data-var='time'>17:59:00</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>
<p><small>May <var data-var='date'> 11</var>, <var data-var='time'>16:54:00</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zletr01jm0znr4lh2w4d9</id>
  <published>2026-05-08T12:31:00.183+00:00</published>
  <updated>2026-05-08T12:31:00.183+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zletr01jm0znr4lh2w4d9"/>
  <title>Increased Error Rate for gpt-5.5 model in the API</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 4 days, 7 hours and 41 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API</p>
    <p><small>May <var data-var='date'> 8</var>, <var data-var='time'>12:31:00</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are investigating the issue for the listed services..</p>
<p><small>May <var data-var='date'> 8</var>, <var data-var='time'>13:26:14</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are seeing partial recovery, but are still working on implementing additional mitigations..</p>
<p><small>May <var data-var='date'> 8</var>, <var data-var='time'>13:42:57</var> GMT+0</small><br /><strong>Identified</strong> -
  We implemented the mitigations and are observing reduction in error rates, but are still seeing higher than normal latency..</p>
<p><small>May <var data-var='date'> 8</var>, <var data-var='time'>13:57:35</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>May <var data-var='date'> 8</var>, <var data-var='time'>14:14:41</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zletq01jk0znrlpnlwge8</id>
  <published>2026-04-29T05:12:25.584+00:00</published>
  <updated>2026-04-29T05:12:25.584+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zletq01jk0znrlpnlwge8"/>
  <title>Users may experience elevated error rate for gpt-4o-mini in the API</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 day, 4 hours and 39 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API</p>
    <p><small>Apr <var data-var='date'> 29</var>, <var data-var='time'>05:12:25</var> GMT+0</small><br /><strong>Identified</strong> -
  We have identified that users are experiencing elevated errors for the impacted services.

We are working on implementing a mitigation..</p>
<p><small>Apr <var data-var='date'> 29</var>, <var data-var='time'>05:19:19</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>Apr <var data-var='date'> 29</var>, <var data-var='time'>05:41:04</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmr2zleqd01ji0znro6z0j272</id>
  <published>2026-04-12T20:40:24.206+00:00</published>
  <updated>2026-04-14T01:26:24.989+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmr2zleqd01ji0znro6z0j272"/>
  <title>Elevated 401 errors for API endpoints</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 1 hour and 18 minutes</p>
    <p><strong>Affected Components:</strong> OpenAI → Chat Completions API</p>
    <p><small>Apr <var data-var='date'> 14</var>, <var data-var='time'>01:26:24</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>Apr <var data-var='date'> 14</var>, <var data-var='time'>08:41:42</var> GMT+0</small><br /><strong>Resolved</strong> -
  All impacted services have now fully recovered..</p>
<p><small>Apr <var data-var='date'> 12</var>, <var data-var='time'>20:40:24</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are investigating the issue for the listed services..</p>
<p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>05:55:20</var> GMT+0</small><br /><strong>Investigating</strong> -
  We are investigating the issue for the listed services..</p>
<p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>17:10:06</var> GMT+0</small><br /><strong>Identified</strong> -
  We&#039;ve identified that intermittent 401 errors on some API endpoints are being caused by timeouts. We have applied mitigations that reduced impact in parts of the system and are continuing to deploy additional fixes and monitor recovery until error rates return to expected levels..</p>
<p><small>Apr <var data-var='date'> 12</var>, <var data-var='time'>22:28:22</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>06:34:30</var> GMT+0</small><br /><strong>Monitoring</strong> -
  We have applied the mitigation and are monitoring the recovery..</p>
<p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>12:57:32</var> GMT+0</small><br /><strong>Identified</strong> -
  We have identified that users are experiencing elevated errors for the impacted services.

We are working on implementing a mitigation..</p>
<p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>20:14:02</var> GMT+0</small><br /><strong>Identified</strong> -
  We&#039;ve identified that intermittent 401 errors on some API endpoints are being caused by timeouts. We have applied mitigations that reduced impact in parts of the system and are continuing to deploy additional fixes and monitor recovery until error rates return to expected levels..</p>
<p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>23:26:27</var> GMT+0</small><br /><strong>Identified</strong> -
  We&#039;ve identified that intermittent 401 errors on some API endpoints are being caused by timeouts. We have applied mitigations that reduced impact in parts of the system and are continuing to deploy additional fixes and monitor recovery until error rates return to expected levels..</p>

        ]]>
  </content>
</entry>

<entry>
  <id>tag:status.upfirst.ai,2005:Incident/cmqtj0i1400jp2knzkpq93tfg</id>
  <published>2026-04-10T17:27:56.000+00:00</published>
  <updated>2026-04-10T17:27:56.000+00:00</updated>
  <link rel="alternate" type="text/html" href="https://status.upfirst.ai/incident/cmqtj0i1400jp2knzkpq93tfg"/>
  <title>Outbound networking issues affecting STT PreRecorded API requests with callbacks, TTS Batch (HTTP) requests with callbacks, and Voice Agent API BYO 3rd party providers (LLM and TTS)</title>

  <content type="html">
  <![CDATA[
    <p><strong>Type:</strong> Incident</p>
    <p><strong>Duration:</strong> 4 days, 19 hours and 35 minutes</p>
    <p><strong>Affected Components:</strong> Deepgram → Text to Speech API</p>
    <p><small>Apr <var data-var='date'> 10</var>, <var data-var='time'>17:27:56</var> GMT+0</small><br /><strong>Identified</strong> -
  A networking incident was identified which resulted in failed callbacks on STT PreRecorded API requests and TTS Batch requests. The issue also affected Voice Agent API sessions with LLM and TTS providers. We have identified a fix and are monitoring traffic. The source of the issue is being investigated..</p>
<p><small>Apr <var data-var='date'> 10</var>, <var data-var='time'>18:15:26</var> GMT+0</small><br /><strong>Monitoring</strong> -
  A network infrastructure fix was implemented at 18:15 UTC and the behavior was immediately resolved. We are continuing to monitor carefully..</p>
<p><small>Apr <var data-var='date'> 13</var>, <var data-var='time'>19:47:31</var> GMT+0</small><br /><strong>Resolved</strong> -
  This incident has been resolved..</p>

        ]]>
  </content>
</entry>

</feed>