DFDS IT incident

Log ingestion issue, some logs are dropped

Resolved after 1 day 10 hours, affecting Grafana Cloud, on September 15, 2026.

monitoring Sep 16, 2026, 12:43 PM UTC

Affected Capabilities have been notified via email. There's still 3 nodes that are occasionally struggling, a fix for those are being rolled out.

Started
Sep 15, 2026, 10:07 AM UTC
Resolved
Sep 16, 2026, 09:07 PM UTC
Duration
1d 10h
Detected by Pingoru
Sep 15, 2026, 10:07 AM UTC

Affected components

Grafana Cloud

Update timeline

  1. investigating Sep 15, 2026, 10:07 AM UTC

    We are currently seeing log ingestion issues, where some logs are dropped. We are investigating.

  2. identified Sep 15, 2026, 11:57 AM UTC

    We have identified the issue. We haven't fixed the cause yet, but things are certainly better now.

  3. monitoring Sep 15, 2026, 07:32 PM UTC

    Backfilling of the logs that could be rescued has been completed. Looking into the possibility of discovering what pods have missing logs from the time period 2 PM CEST till 15:00 PM CEST ish. Capabilities that hasn't had all of their logs backfilled will be notified if possible.

  4. monitoring Sep 16, 2026, 12:43 PM UTC

    Affected Capabilities have been notified via email. There's still 3 nodes that are occasionally struggling, a fix for those are being rolled out.

  5. resolved Sep 16, 2026, 09:07 PM UTC

    This incident has been resolved.

Your product runs on more than DFDS IT

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →