Happo incident

Increased error rates for snap-request jobs

Resolved after 1 hour 12 minutes, affecting API, on June 2, 2025.

resolved Jun 02, 2025, 08:17 PM UTC

We have found the root cause of this issue now. A temporary fix is currently active and we are soon to deploy a proper fix. The issue was caused by a stale cache that caused snap-request jobs to not save properly.

Started
Jun 02, 2025, 07:05 PM UTC
Resolved
Jun 02, 2025, 08:17 PM UTC
Duration
1h 12m
Detected by Pingoru
Jun 02, 2025, 07:05 PM UTC

Affected components

API

Update timeline

  1. investigating Jun 02, 2025, 07:05 PM UTC

    We are investigating an issue with snap-requests randomly failing with a `HTTP error 404: http://happo-view-service/api/snap-requests/:id/payload -- Not Found` error.

  2. resolved Jun 02, 2025, 08:17 PM UTC

    We have found the root cause of this issue now. A temporary fix is currently active and we are soon to deploy a proper fix. The issue was caused by a stale cache that caused snap-request jobs to not save properly.

Your product runs on more than Happo

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →