Braintrust incident

High rate of errors on control plane

Resolved after 1 hour 5 minutes, affecting Web UI / Control Plane, on May 5, 2026.

resolved May 06, 2026, 12:41 AM UTC

The issue was caused by our firewall provider unexpectedly blocking traffic despite safeguards we had in place to prevent this behavior. We are actively working with the vendor on additional mitigation measures to reduce the likelihood of this occurring again.

Started
May 05, 2026, 11:35 PM UTC
Resolved
May 06, 2026, 12:41 AM UTC
Duration
1h 5m
Detected by Pingoru
May 05, 2026, 11:35 PM UTC

Affected components

Web UI / Control Plane

Update timeline

  1. investigating May 05, 2026, 11:35 PM UTC

    We're observing a high rate of errors on the production control plane which is causing errors on braintrust.dev and data plane operations.

  2. identified May 06, 2026, 12:08 AM UTC

    We have identified the cause and are working with an upstream provider on a fix.

  3. monitoring May 06, 2026, 12:10 AM UTC

    We are actively monitoring the fix.

  4. resolved May 06, 2026, 12:23 AM UTC

    We are no longer seeing issues.

  5. resolved May 06, 2026, 12:41 AM UTC

    The issue was caused by our firewall provider unexpectedly blocking traffic despite safeguards we had in place to prevent this behavior. We are actively working with the vendor on additional mitigation measures to reduce the likelihood of this occurring again.

Your product runs on more than Braintrust

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →