Wasabi incident

System Errors in EU-WEST-3

Resolved after 3 hours, affecting EU-West-3 (London), on July 25, 2025.

postmortem Aug 27, 2025, 02:55 PM UTC

On 25 July 2025 from 19:06 UTC to approximately 21:14 UTC, Wasabi's eu-west-3 \(London\) region experienced a service incident which resulted in elevated HTTP 5XX errors being returned for many request types to the region. The cause for the incident was an internal service failure, which prevented multiple services within the region from being able to successfully communicate across platforms. Due to this failure, our internal proxy service was unable to efficiently direct requests within the region, resulting in a degradation of the service and causing client requests to fail. Wasabi's Engineering and Operations teams worked to systematically restart impacted service hosts beginning at 19:20 UTC through 19:28 UTC. Once the hosts were back online, internal routing issues due to faulty configuration files required the team to manually correct the configurations and apply those to service hosts. By 21:24 UTC, all hosts and services were operating properly, and the region was operational.

Started
Jul 25, 2025, 07:31 PM UTC
Resolved
Jul 25, 2025, 10:32 PM UTC
Duration
3h
Detected by Pingoru
Jul 25, 2025, 07:31 PM UTC

Affected components

EU-West-3 (London)

Update timeline

  1. investigating Jul 25, 2025, 07:31 PM UTC

    We are currently experiencing system errors in our EU-WEST-3 region. Customers may experience elevated HTTP 5XX error responses when interacting with their Wasabi bucket(s). We will update this page as we have more information.

  2. identified Jul 25, 2025, 08:21 PM UTC

    We have identified the problem and our team is currently working to correct it.

  3. monitoring Jul 25, 2025, 09:26 PM UTC

    The issue has been corrected by our Operations Team and the EU-WEST-3 region is now fully operational. We will continue to monitor the region

  4. resolved Jul 25, 2025, 10:32 PM UTC

    This incident has been resolved.

  5. postmortem Aug 27, 2025, 02:55 PM UTC

    On 25 July 2025 from 19:06 UTC to approximately 21:14 UTC, Wasabi's eu-west-3 \(London\) region experienced a service incident which resulted in elevated HTTP 5XX errors being returned for many request types to the region. The cause for the incident was an internal service failure, which prevented multiple services within the region from being able to successfully communicate across platforms. Due to this failure, our internal proxy service was unable to efficiently direct requests within the region, resulting in a degradation of the service and causing client requests to fail. Wasabi's Engineering and Operations teams worked to systematically restart impacted service hosts beginning at 19:20 UTC through 19:28 UTC. Once the hosts were back online, internal routing issues due to faulty configuration files required the team to manually correct the configurations and apply those to service hosts. By 21:24 UTC, all hosts and services were operating properly, and the region was operational.

Your product runs on more than Wasabi

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →