Courier incident

Delayed Message Processing

Resolved after 4 hours 10 minutes, affecting API, on October 24, 2024.

monitoring Oct 25, 2024, 02:43 AM UTC

A fix has been implemented and delivery times are beginning to returning to expected levels. The team will continue to monitor.

Started
Oct 24, 2024, 10:38 PM UTC
Resolved
Oct 25, 2024, 02:48 AM UTC
Duration
4h 10m
Detected by Pingoru
Oct 24, 2024, 10:38 PM UTC

Affected components

API

Update timeline

  1. investigating Oct 24, 2024, 10:38 PM UTC

    Courier has identified a delay in message processing for the messages API. We are currently investigating the root cause and will update you periodically.

  2. investigating Oct 24, 2024, 11:01 PM UTC

    We are continuing to monitor the root cause of the delayed message processing.

  3. investigating Oct 24, 2024, 11:29 PM UTC

    The team is still investigating and discussing the root cause internally. Messages are experiencing longer than normal processing times.

  4. identified Oct 25, 2024, 12:00 AM UTC

    The team has identified the issue and is rolling out a fix for the message delays.

  5. identified Oct 25, 2024, 12:40 AM UTC

    Fix has been deployed and will be live in around 1hr.

  6. identified Oct 25, 2024, 01:31 AM UTC

    The team identified an issue with the latest fix and reverted it. A new fix has been published to mitigate the message delay issue. ETA to land in production ~45 minutes.

  7. monitoring Oct 25, 2024, 02:43 AM UTC

    A fix has been implemented and delivery times are beginning to returning to expected levels. The team will continue to monitor.

  8. resolved Oct 25, 2024, 02:48 AM UTC

    This incident has been resolved

Your product runs on more than Courier

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →