Depot Outage History

Depot is up right now

Pingoru has recorded 77 incidents for Depot: 77 in the last 12 months and 9 in the last 90 days.

Source: status.depot.dev

77incidents recorded
77last 12 months
9last 90 days
62 minutestypical duration
Incidents per month
01020AprMayJunJulAugSepOct3
Share of hours with an open incident, any severity
0%50%100%AprMayJunJulAugSepOct1%
Pingoru began tracking Depot in April 2026, so earlier months are not shown. Hover a bar for its value.
Show as a table
MonthIncidentsHours with an open incident
April 20261212 of 720 (2%)
May 2026106 of 744 (1%)
June 202665 of 720 (1%)
July 202656 of 744 (1%)
August 202621 of 744 (0%)
September 202632 of 720 (0%)
October 202635 of 592 (1%)

Incidents, newest first

Minor May 13, 2026 Job's relying on OIDC are unable to be authenticated 40m Depot CI

Started May 13, 2026, 08:16 PM UTC· resolved May 13, 2026, 08:56 PM UTC

  1. identified May 13, 2026, 08:16 PM UTC

    Job's relying on OIDC are unable to be authenticated. The issue has been identified and we're deploying a fix.

  2. resolved May 13, 2026, 08:56 PM UTC

    This has been resolved.

Read the full incident report →

Minor May 13, 2026 Depot CI Jobs are experiencing higher queue times 38m Depot CI

Started May 13, 2026, 06:35 PM UTC· resolved May 13, 2026, 07:13 PM UTC

  1. investigating May 13, 2026, 06:35 PM UTC

    We are investigating higher queue times for Depot CI jobs.

  2. monitoring May 13, 2026, 07:07 PM UTC

    We've deployed a fix and are monitoring recovery.

  3. resolved May 13, 2026, 07:13 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor May 4, 2026 GitHub API Outage 42m GitHub.com

Started May 04, 2026, 04:05 PM UTC· resolved May 04, 2026, 04:48 PM UTC

  1. investigating May 04, 2026, 04:05 PM UTC

    GitHub is currently experiencing an outage: https://www.githubstatus.com/incidents/72q3n8yxthcy that is affecting a number of internal services. We expect this to disrupt delivery of jobs to Depot-hosted runners. We'll continue to monitor the situation.

  2. monitoring May 04, 2026, 04:38 PM UTC

    GitHub has indicated that their incident has been mitigated. We'll continue to monitor the situation.

  3. resolved May 04, 2026, 04:48 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor April 23, 2026 Missing logs and metrics for Jobs 1h 5m Depot CI, us-east-1

Started Apr 23, 2026, 07:57 PM UTC· resolved Apr 23, 2026, 09:03 PM UTC

  1. investigating Apr 23, 2026, 07:57 PM UTC

    Jobs are still running. We are investigating the missing logs and metrics.

  2. identified Apr 23, 2026, 08:14 PM UTC

    Identified the issue and working on a fix.

  3. investigating Apr 23, 2026, 08:19 PM UTC

    We are investigating.

  4. monitoring Apr 23, 2026, 08:49 PM UTC

    We've applied a fix and are monitoring.

  5. resolved Apr 23, 2026, 09:03 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor April 16, 2026 Database Outage 44m API, Depot CI, Depot Cache, Container Registry and 3 more

Started Apr 16, 2026, 01:06 AM UTC· resolved Apr 16, 2026, 01:50 AM UTC

  1. investigating Apr 16, 2026, 01:06 AM UTC

    Investigating

  2. identified Apr 16, 2026, 01:24 AM UTC

    We have identified the cause as an outage of our primary database

  3. identified Apr 16, 2026, 01:34 AM UTC

    We have worked with our database provider to restore database connectivity - CI jobs and container builds are operational and are now processing the backlog of jobs.

  4. resolved Apr 16, 2026, 01:50 AM UTC

    This incident has been resolved, the backlog of jobs has processed successfully.

Read the full incident report →

Minor April 14, 2026 High number of failed of early sandbox termination 30m Depot CI

Started Apr 14, 2026, 10:41 PM UTC· resolved Apr 14, 2026, 11:11 PM UTC

  1. investigating Apr 14, 2026, 10:41 PM UTC

    We're investigating the reports of early sandbox termination. We are seeing some jobs work but many fail.

  2. resolved Apr 14, 2026, 11:11 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor April 8, 2026 Increased Ubuntu x86 job queue time 4h 31m us-east-1

Started Apr 08, 2026, 04:25 PM UTC· resolved Apr 08, 2026, 08:57 PM UTC

  1. investigating Apr 08, 2026, 04:25 PM UTC

    We are investigating reports of increased queue time for x86 Ubuntu GitHub Actions jobs.

  2. identified Apr 08, 2026, 07:26 PM UTC

    We are continuing to see capacity issues across us-east-1 and us-east-2 inside of AWS. While this is ongoing, we are rerouting jobs to AZs in regions with capacity. We are in contact with AWS to get additional capacity in the impacted regions released. This degraded performance is only impacting GitHub Actions runners to date.

  3. monitoring Apr 08, 2026, 08:30 PM UTC

    We have deployed an additional remediation for our cross-region failover to increase job-launch throughput while AWS instance capacity is limited. Early signs are showing fewer capacity errors, but we are continuing to monitor the situation.

  4. resolved Apr 08, 2026, 08:57 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor March 30, 2026 depot.dev app 502 8m Dashboard

Started Mar 30, 2026, 10:42 PM UTC· resolved Mar 30, 2026, 10:51 PM UTC

  1. identified Mar 30, 2026, 10:42 PM UTC

    Experiencing periodic 502's on various pages of the depot.dev web application.

  2. resolved Mar 30, 2026, 10:51 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor March 30, 2026 Depot.dev appears with occasional 502 20m Dashboard

Started Mar 30, 2026, 08:41 PM UTC· resolved Mar 30, 2026, 09:01 PM UTC

  1. investigating Mar 30, 2026, 08:41 PM UTC

    We're investigating 502's occurring when trying to navigate to depot.dev and it's corresponding web application.

  2. resolved Mar 30, 2026, 09:01 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor March 26, 2026 Longer queue times for Ubuntu 24.04 jobs 8m us-east-1

Started Mar 26, 2026, 05:38 PM UTC· resolved Mar 26, 2026, 05:47 PM UTC

  1. investigating Mar 26, 2026, 05:38 PM UTC

    We're seeing longer queue times for Ubuntu 24.04 jobs due to upstream capacity limitations.

  2. resolved Mar 26, 2026, 05:47 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor March 19, 2026 Intermittent failures for GitHub Actions x86 jobs 3h 26m us-east-1

Started Mar 19, 2026, 03:02 PM UTC· resolved Mar 19, 2026, 06:28 PM UTC

  1. identified Mar 19, 2026, 03:02 PM UTC

    We have identified an issue causing a small percentage of x86 GitHub Actions jobs to fail to start and have deployed a mitigation.

  2. monitoring Mar 19, 2026, 03:04 PM UTC

    The mitigation has cleared the backlog of jobs, everything appears healthy. We will continue to monitor.

  3. monitoring Mar 19, 2026, 03:10 PM UTC

    We are still seeing some instability with x86 job launches - our control plane is scaling up additional capacity to compensate.

  4. identified Mar 19, 2026, 03:44 PM UTC

    We are continuing to see reduced AWS capacity in us-east-1 and us-east-2, causing increased queue times or failures to start for some jobs.

  5. resolved Mar 19, 2026, 06:28 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor March 9, 2026 Some GitHub jobs failing to connect 1h 31m us-east-1

Started Mar 09, 2026, 02:59 PM UTC· resolved Mar 09, 2026, 04:30 PM UTC

  1. investigating Mar 09, 2026, 02:59 PM UTC

    We are investigating reports of some GitHub runners failing to connect to GitHub

  2. identified Mar 09, 2026, 03:08 PM UTC

    Errors seem to be caused in part by lack of instance capacity in our primary runner instance pool, we are activating a failover instance pool to unblock jobs.

  3. identified Mar 09, 2026, 03:20 PM UTC

    Failover capacity is online and job throughput is increasing.

  4. identified Mar 09, 2026, 03:35 PM UTC

    AWS are experiencing broad capacity constraints around our preferred instance type, we are activating a fallback to secondary instance type to address.

  5. monitoring Mar 09, 2026, 03:56 PM UTC

    All failover infrastructure is live and job service is restored. We will continue to address the underlying cause.

  6. resolved Mar 09, 2026, 04:30 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor March 3, 2026 Longer queue times for Ubuntu 24.04 Actions jobs 23m us-east-1

Started Mar 03, 2026, 03:09 PM UTC· resolved Mar 03, 2026, 03:32 PM UTC

  1. investigating Mar 03, 2026, 03:09 PM UTC

    We are investigating alerts about longer queue times for Ubuntu 24.04 x86 Actions jobs

  2. resolved Mar 03, 2026, 03:32 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor March 1, 2026 Database performance issues 57m API, Dashboard

Started Mar 01, 2026, 07:04 PM UTC· resolved Mar 01, 2026, 08:02 PM UTC

  1. investigating Mar 01, 2026, 07:04 PM UTC

    We are investigating alerts about high replication lag on Depot's primary database.

  2. identified Mar 01, 2026, 07:41 PM UTC

    We are working with our database provider to deploy a mitigation for the increased read-replica lag.

  3. resolved Mar 01, 2026, 08:02 PM UTC

    Mitigation is deployed, this incident has been resolved.

Read the full incident report →

Minor February 26, 2026 Unable to provision Windows runners. 23m us-east-1

Started Feb 26, 2026, 08:11 PM UTC· resolved Feb 26, 2026, 08:34 PM UTC

  1. investigating Feb 26, 2026, 08:11 PM UTC

    We are investigating an issue where Windows Runners are not being assigned a machine.

  2. identified Feb 26, 2026, 08:28 PM UTC

    We have identified the issue and are working on a fix.

  3. resolved Feb 26, 2026, 08:34 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor February 23, 2026 We are investigating alerts about elevated queue time for GitHub Actions jobs 17m us-east-1

Started Feb 23, 2026, 07:54 PM UTC· resolved Feb 23, 2026, 08:11 PM UTC

  1. investigating Feb 23, 2026, 07:54 PM UTC

    We are investigating alerts about elevated queue time for GitHub Actions jobs.

  2. monitoring Feb 23, 2026, 08:02 PM UTC

    We identified the issue as due to upstream AWS capacity. We're routing traffic internally to mitigate.

  3. resolved Feb 23, 2026, 08:11 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor February 23, 2026 Increased GitHub Actions queue time 41m us-east-1

Started Feb 23, 2026, 04:27 PM UTC· resolved Feb 23, 2026, 05:09 PM UTC

  1. investigating Feb 23, 2026, 04:27 PM UTC

    We are investigating alerts about elevated queue time for GitHub Actions jobs

  2. identified Feb 23, 2026, 04:38 PM UTC

    The increased delay is related to decreased AWS capacity in a single zone, the Depot control plane is routing traffic around the affected zone.

  3. resolved Feb 23, 2026, 05:09 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor February 17, 2026 Some GitHub Actions jobs timing out 39m us-east-1

Started Feb 17, 2026, 04:20 PM UTC· resolved Feb 17, 2026, 05:00 PM UTC

  1. investigating Feb 17, 2026, 04:20 PM UTC

    We are observing issues with some percentage of GitHub Actions jobs failing to be delivered to their runner in a 10-minute window of time, causing them to time out. We are investigating.

  2. identified Feb 17, 2026, 04:27 PM UTC

    We have identified a GitHub API issue causing this delay. Jobs are starting to process now, we have deployed additional capacity to handle the incoming jobs.

  3. monitoring Feb 17, 2026, 04:36 PM UTC

    Jobs are processing successfully. GitHub themselves do seem to be experiencing increased instability in their API, causing jobs to retry downloading actions, sometimes fail to clone, etc.

  4. resolved Feb 17, 2026, 05:00 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor February 9, 2026 GitHub API outage 51m GitHub.com

Started Feb 09, 2026, 04:47 PM UTC· resolved Feb 09, 2026, 05:39 PM UTC

  1. monitoring Feb 09, 2026, 04:47 PM UTC

    GitHub is currently experiencing an outage: https://www.githubstatus.com/incidents/smf24rvl67v9 that is affecting the GitHub API, git operations, Actions, and more. We expect this to disrupt delivery of jobs to Depot-hosted runners.

  2. resolved Feb 09, 2026, 05:39 PM UTC

    GitHub have closed their Actions incident.

Read the full incident report →

Minor February 3, 2026 Ongoing GitHub Incident 42m GitHub.com

Started Feb 03, 2026, 05:26 PM UTC· resolved Feb 03, 2026, 06:08 PM UTC

  1. monitoring Feb 03, 2026, 05:26 PM UTC

    GitHub are currently experiencing an incident that is causing delays in Actions job delivery. We are monitoring the impact on Depot-hosted runners.

  2. resolved Feb 03, 2026, 06:08 PM UTC

    This incident has been resolved.

Read the full incident report →

Minor January 31, 2026 Analytics and usage insights outage 1h 10m Depot Cache, Dashboard

Started Jan 31, 2026, 09:50 AM UTC· resolved Jan 31, 2026, 11:00 AM UTC

  1. investigating Jan 31, 2026, 09:50 AM UTC

    We are investigating an issue impacting our analytics storage cluster. Analytics and usage pages are failing to load.

  2. identified Jan 31, 2026, 10:13 AM UTC

    We have identified this as caused by an upstream provider outage: https://status.clickhouse.com/incidents/01KG9R4QYASZW9VXHG3S2YD4WD in us-east-1. We will monitor the progress of that incident.

  3. resolved Jan 31, 2026, 11:00 AM UTC

    The upstream provider has restored service, analytics are available in the dashboard again.

Read the full incident report →

Major January 14, 2026 GitHub Actions jobs failing to start 30m

Started Jan 14, 2026, 10:42 AM UTC· resolved Jan 14, 2026, 11:13 AM UTC

No vendor updates were posted for this incident.

Read the full incident report →

Major January 6, 2026 Issues with machines being acquired and higher latency on Dashboard 59m

Started Jan 06, 2026, 07:30 AM UTC· resolved Jan 06, 2026, 08:30 AM UTC

No vendor updates were posted for this incident.

Read the full incident report →

Major December 11, 2025 Some container builds unable to start 2h 18m

Started Dec 11, 2025, 03:00 PM UTC· resolved Dec 11, 2025, 05:18 PM UTC

No vendor updates were posted for this incident.

Read the full incident report →

Major December 10, 2025 Some container builds in us-east-1 failing to acquire build machines 1h 31m

Started Dec 10, 2025, 02:17 PM UTC· resolved Dec 10, 2025, 03:49 PM UTC

No vendor updates were posted for this incident.

Read the full incident report →