Blacksmith incident

Blacksmith control plane outage

Major

Resolved after 6 hours 35 minutes, affecting EU Central (eu-central ARM) and EU Central (eu-central x86) and 1 more, on May 11, 2026.

resolved May 11, 2026, 10:31 PM UTC

This incident has been resolved. Queue times are back to normal, we are working on mitigations on our end to prevent such load based degradations in the future.

Started
May 11, 2026, 03:56 PM UTC
Resolved
May 11, 2026, 10:31 PM UTC
Duration
6h 35m
Detected by Pingoru
May 11, 2026, 03:56 PM UTC

Affected components

EU Central (eu-central ARM)EU Central (eu-central x86)US West (us-west ARM)US West (us-west x86)EU West (eu-west x86)US Central (us-central MacOS)

Update timeline

  1. investigating May 11, 2026, 03:56 PM UTC

    There may be some delays with job adoption

  2. monitoring May 11, 2026, 03:58 PM UTC

    We implemented a fix and are re-queuing jobs in the backlog

  3. monitoring May 11, 2026, 07:32 PM UTC

    We are still investigating issues with slow job adoption.

  4. identified May 11, 2026, 08:30 PM UTC

    We are continuing to face issues with our upstream database provider. We are working with them to root cause the problem.

  5. resolved May 11, 2026, 10:31 PM UTC

    This incident has been resolved. Queue times are back to normal, we are working on mitigations on our end to prevent such load based degradations in the future.

Your product runs on more than Blacksmith

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →