Scorechain incident

Major outage

Resolved after 3 hours 34 minutes, affecting API and application and Login, on January 13, 2025.

postmortem Jan 16, 2025, 01:40 PM UTC

Postmortem from our underlying provider : To meet the growing demands of our customers for bandwidth, we have successfully commissioned a new higher-capacity interconnection with one of our transit providers. The decommissioning of older, lower-capacity links caused an unforeseen routing loop on Monday, January 13, at 10:00 a.m. Our technical teams were immediately alerted. The incident was identified, and a corrective measure was implemented at 10:24 a.m. to enhance the reliability of this process and prevent any recurrence. Since this intervention, all services have been restored and are fully operational.

Started
Jan 13, 2025, 09:13 AM UTC
Resolved
Jan 13, 2025, 12:48 PM UTC
Duration
3h 34m
Detected by Pingoru
Jan 13, 2025, 09:13 AM UTC

Affected components

API and applicationLogin

Update timeline

  1. identified Jan 13, 2025, 09:13 AM UTC

    We are currently experiencing a major outage across the entire application due to an external service provider. We will keep you informed of further developments.

  2. monitoring Jan 13, 2025, 09:32 AM UTC

    All components are fully operational again. We are continuing to monitor the situation.

  3. resolved Jan 13, 2025, 12:48 PM UTC

    This incident has been resolved.

  4. postmortem Jan 16, 2025, 01:40 PM UTC

    Postmortem from our underlying provider : To meet the growing demands of our customers for bandwidth, we have successfully commissioned a new higher-capacity interconnection with one of our transit providers. The decommissioning of older, lower-capacity links caused an unforeseen routing loop on Monday, January 13, at 10:00 a.m. Our technical teams were immediately alerted. The incident was identified, and a corrective measure was implemented at 10:24 a.m. to enhance the reliability of this process and prevent any recurrence. Since this intervention, all services have been restored and are fully operational.

Your product runs on more than Scorechain

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →