Bland incident

Degraded TTS

Resolved after 1 hour 30 minutes, on March 4, 2026.

resolved Mar 04, 2026, 08:59 PM UTC

Our BTTS service experienced degraded performance due to a failure in our underlying cloud infrastructure's ability to scale compute capacity to meet demand. This resulted in agents stuttering, failing to vocalize responses, increased latency, or producing incomplete audio output during the affected window, for calls that utilize BTTS v2 voices. The timeline was as follows: 6:00 AM PST: BTTS model began failing to scale due to insufficient compute capacity in its assigned cloud cluster. 6:30 AM PST: An automated alert fired but was misconfigured as non-critical and was not actioned. ~8:00 AM PST: Rising call volume exceeded available capacity, causing noticeable impact to production calls. 9:11 AM PST: We identified degraded performance through internal monitoring and began investigating. 9:32 AM PST: BTTS compute was migrated to a separate cloud cluster with available capacity. Scaling resumed normally and performance returned to baseline.

Started
Mar 04, 2026, 04:00 PM UTC
Resolved
Mar 04, 2026, 05:30 PM UTC
Duration
1h 30m
Detected by Pingoru
Mar 04, 2026, 04:00 PM UTC

Update timeline

  1. resolved Mar 04, 2026, 08:59 PM UTC

    Our BTTS service experienced degraded performance due to a failure in our underlying cloud infrastructure's ability to scale compute capacity to meet demand. This resulted in agents stuttering, failing to vocalize responses, increased latency, or producing incomplete audio output during the affected window, for calls that utilize BTTS v2 voices. The timeline was as follows: 6:00 AM PST: BTTS model began failing to scale due to insufficient compute capacity in its assigned cloud cluster. 6:30 AM PST: An automated alert fired but was misconfigured as non-critical and was not actioned. ~8:00 AM PST: Rising call volume exceeded available capacity, causing noticeable impact to production calls. 9:11 AM PST: We identified degraded performance through internal monitoring and began investigating. 9:32 AM PST: BTTS compute was migrated to a separate cloud cluster with available capacity. Scaling resumed normally and performance returned to baseline.

Your product runs on more than Bland

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →