DFDS IT incident

Prometheus data source missing gaps of data

Resolved after 1 hour 56 minutes, on May 29, 2025.

resolved May 29, 2025, 12:35 PM UTC

Incident itself is resolved, but the actual origin of the issue not quite yet. If you experience further issues with no data don’t hesitate to reach out directly via Slack to emcla.

Started
May 29, 2025, 10:38 AM UTC
Resolved
May 29, 2025, 12:35 PM UTC
Duration
1h 56m
Detected by Pingoru
May 29, 2025, 10:38 AM UTC

Update timeline

  1. identified May 29, 2025, 10:38 AM UTC

    Due to metrics collector going OOM sporadically since yesterday, metrics shipped from Hellman has been partly missing in Grafana Cloud. Working on implementing a fix now.

  2. monitoring May 29, 2025, 11:32 AM UTC

    Fix implemented. Seems stable for now, but without having resolved the root cause I suspect it'll probably happen again. Will keep monitoring it.

  3. resolved May 29, 2025, 12:35 PM UTC

    Incident itself is resolved, but the actual origin of the issue not quite yet. If you experience further issues with no data don’t hesitate to reach out directly via Slack to emcla.

Your product runs on more than DFDS IT

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →