Penguin Internet Outage History

Started Jul 08, 2026, 11:31 PM UTC· resolved Jul 08, 2026, 11:48 PM UTC

1. investigating Jul 08, 2026, 11:31 PM UTC

   We are aware of an issue with the cPanel licence servers which may prevent you from logging into the control panel. cPanel are aware of this and working on a fix: https://support.cpanel.net/hc/en-us/articles/41816676353943-cPanel-License-Update-Failures-July-8th-2026 Unfortunately there is nothing that we can do to resolve this - it requires cPanel address the issue with their licence servers.

2. resolved Jul 08, 2026, 11:48 PM UTC

   cPanel have updated this case to inform that the issue has been resolved. cPanel services should be accessible as per normal now.

Read the full incident report →

Started Jun 19, 2026, 02:50 PM UTC· resolved Oct 20, 2026, 02:48 AM UTC

1. investigating Jun 19, 2026, 02:50 PM UTC

   We are currently investigating a complete network outage at the datacentre. There has been no scheduled maintenance and they have confirmed that reports have been received from other customers, therefore this issue does not appear to be with our own equipment, rather than being further upstream. They are investigating and will update us shortly.

2. identified Jun 19, 2026, 03:34 PM UTC

   We have been informed that there has been a power issue at the datacentre, taking out both of our redundant power feeds and therefore powering down all of our equipment in all racks. Power has now been restored, and services are coming back up and we are working through all servers to check everything has recovered correctly. Until we have further detail as to the cause however, we do not know if they have resolved the issue yet.

3. monitoring Jun 19, 2026, 03:50 PM UTC

   All services are responding correctly. Now that this has recovered, we can see that no power was lost to our infrastructure - this was a networking outage from our transit provider. We are awaiting a formal notice from our transit provider, as it may be that their equipment upstream was affected by a power outage.

Read the full incident report →

Started Jun 15, 2026, 03:10 PM UTC· resolved Oct 20, 2026, 02:49 AM UTC

1. investigating Jun 15, 2026, 03:10 PM UTC

   Our monitoring systems have indicated a power loss to our A feeds within the datacentre. Our racks are powered by two independent feeds, namely A and B. We previously received notice of upcoming maintenance on the feeds, however we were specifically assured that there would not be any power feed impact today. This means that any servers that are single fed and from the A supply will currently be impacted. This is a very small number of dedicated server customers as all our core infrastructure and servers are dual fed and so continue to operate. We will update once ed have a response from the datacentre.

2. investigating Jun 15, 2026, 04:19 PM UTC

   Power was restored shortly afterwards, however we are still awaiting a formal RFO from the datacentre and to confirm that there will not be any further issues

Read the full incident report →

Started May 25, 2026, 04:13 PM UTC· resolved May 25, 2026, 08:27 PM UTC

1. investigating May 25, 2026, 04:13 PM UTC

   Please be aware that our monitoring systems have detected an excessive temperatures today with the data halls. We have raised this with the data centre, however are having frustratingly slow responses due to to the bank holiday. Currently we have devices that are over 15 deg high temperature that they should be and temperatures are still rising. Due to this, we are considering our entire infrastructure at risk currently. We are currently escalating this with their engineers for an immediate resolution as there is clearly a cooling issue on site.

2. monitoring May 25, 2026, 05:19 PM UTC

   The data centre are working on overheating cooling units and are spraying the external units with water to reduce the data hall temperature. All temperatures on our monitoring are showing a reduction and we will continue to monitor this.

3. resolved May 25, 2026, 08:27 PM UTC

   Temperatures have been back to normal for a few hours now and we have confirmation the datacentre will be managing this over the next few days. We will however be following up for a formal response as to how this situation managed to arise.

Read the full incident report →

Started Apr 30, 2026, 08:46 AM UTC· resolved Apr 30, 2026, 11:44 AM UTC

1. investigating Apr 30, 2026, 08:46 AM UTC

   cPanel have today released details of a zero day cPanel vulnerability that allows authentication bypass to servers and hosting accounts. We are in the process of deploying emergency updates to all servers to patch this, therefore some services may be briefly affected whilst the updates are applied. Please note, cPanel and WHM access is blocked until the updates are complete https://support.cpanel.net/hc/en-us/articles/40073787579671-Security-CVE-2026-41940-cPanel-WHM-WP2-Security-Update-04-28-2026

2. resolved Apr 30, 2026, 11:44 AM UTC

   We can confirm that all servers have been patched against this vulnerability. We have also undertaken a detailed security audit of all servers to identify any activity that may have been linked to this. Thankfully, due to our security hardening in place on our servers, the automated attacks were not able to do any damage to servers or accounts. We will continue to investigate this in the background and are adding further security measures to prevent any future such issues.

Read the full incident report →

Started Nov 21, 2025, 02:40 PM UTC· resolved Nov 21, 2025, 02:48 PM UTC

1. investigating Nov 21, 2025, 02:40 PM UTC

   We are currently investigating a connectivity issue with reseller server 3

2. resolved Nov 21, 2025, 02:48 PM UTC

   Connectivity has been restored to the server and we are monitoring this as well as reviewing logs. The server restarted due to a watchdog event and we are investigating the cause of this.

Read the full incident report →

Started Oct 10, 2025, 11:30 AM UTC· resolved Oct 14, 2025, 11:30 PM UTC

1. investigating Oct 10, 2025, 11:30 AM UTC

   Our monitoring systems have alerted us to a power supply failure on one of our core racks. The majority of servers in this rack are dual fed and so will continue to operate, however some less essential services may be affected. We are currently investigating the cause of this with the datacentre

2. investigating Oct 10, 2025, 12:01 PM UTC

   The datacentre are still investigating this. We saw power restored to the one APC and so services connected to that came back up, however we are seeing issues in another rack now, leading us to believe there is a power distribution issue at the datacentre, specifically within that particular data hall We will update as we receive an update from them.

3. identified Oct 10, 2025, 12:57 PM UTC

   The datacentre have confirmed that they have experienced power issues in the data hall that our affected racks are in, however at this point we do not know the cause of it. They have confirmed that the issue has been resolved, however at this point we are still investigating some further power distribution issues within our racks in that hall.

4. identified Oct 10, 2025, 01:22 PM UTC

   The datacentre have informed us that there has been a power outage to 4 data halls. Whilst the issue has been resolved, they have Schneider enroute to investigate further (Schneider manage the power infrastructure there). Whilst they have assured us that power has been restored, we are having issues with one of our PDUs which is indicating some damage to it following the incident. We are investigating this and have staff on their way to the datacentre too.

5. monitoring Oct 10, 2025, 03:03 PM UTC

   A small number of server customers were affected who did not have dual fed equipment and their servers are now back online again. We have suffered some PDU damage and will be replacing components, however this is for equipment that is now not currently now in use. We are therefore running at risk due to limited redundancy for those servers.

6. resolved Oct 14, 2025, 11:30 PM UTC

   We can confirm that the damaged power distribution equipment has been replaced and all infrastructure is running normally now

Read the full incident report →

Started Jun 08, 2025, 04:21 PM UTC· resolved Jun 08, 2025, 10:09 PM UTC

1. investigating Jun 08, 2025, 04:21 PM UTC

   We are currently investigating an issue with intermittent high latency on our transit uplinks. We have raised a case with our transit supplier to investigate this.

2. monitoring Jun 08, 2025, 04:39 PM UTC

   Since logging the call with our transit supplier, latency shortly afterwards returned to normal and so they appear to have resolved the issue. We are awaiting an update from them and will continue to monitor in the meantime

3. resolved Jun 08, 2025, 10:09 PM UTC

   Our supplier has informed us that the issue was due to a faulty BT line card which was resolved earlier. The initial replacement card was dead on arrival and they therefore needed to source another replacement. Full details are in the process of being sent to us.

Read the full incident report →

Started Apr 09, 2025, 11:33 AM UTC· resolved Apr 09, 2025, 11:33 AM UTC

1. resolved Apr 09, 2025, 11:33 AM UTC

   Due to outages in the area around our offices, our telephone systems are not currently available. Support is still available via ticket and email. No other services are affected.

Read the full incident report →

Started Mar 17, 2025, 05:30 PM UTC· resolved Mar 17, 2025, 06:00 PM UTC

1. investigating Mar 17, 2025, 05:30 PM UTC

   We are currently investigating an issue with connectivity to Reseller Server 7

2. identified Mar 17, 2025, 05:40 PM UTC

   The server had become non-responsive and so we have rebooted it. All services are coming back up and we will investigate further

3. resolved Mar 17, 2025, 06:00 PM UTC

   All services are now operating normally. The logs show a very significant distributed brute force attack against a site that was running an obsolete version of WordPress and thus was likely targeted due to this. As a result, this site has been taken offline as this does not comply with our terms. We will continue to monitor however do not anticipate any further issues.

Read the full incident report →

Started Jan 07, 2025, 05:50 PM UTC· resolved Jan 07, 2025, 10:15 PM UTC

1. investigating Jan 07, 2025, 05:50 PM UTC

   We have received some reports regarding customers on Vodafone not being able to access our network. We have confirmed this and traffic is stopping just short of our network with a transit provider and so outside of our control. We have therefore raised a ticket with the provider to investigate this further and we will update as further information is known.

2. resolved Jan 07, 2025, 10:15 PM UTC

   The issue appears to have resolved itself. Our transit provider cannot find anything logged in relation to this either. We will monitor this to ensure there are no further issues.

Read the full incident report →

Started Nov 04, 2024, 12:03 PM UTC· resolved Nov 04, 2024, 02:28 PM UTC

1. investigating Nov 04, 2024, 12:03 PM UTC

   We are currently experiencing a power outage to all buildings in the area for our office. This means that our support is limited and telephones are not currently available. This has no impact on our hosting services. Power restoration is expected by 13:30pm https://powercuts.nationalgrid.co.uk/CF34FD

2. monitoring Nov 04, 2024, 12:52 PM UTC

   Power has now been restored and our systems are restarting. We will continue to monitor this until Western Power confirm the issue is resolved

3. monitoring Nov 04, 2024, 01:20 PM UTC

   Western Power have updated their rectification time to 14:30 and so there may still be disruption to our offices until resolved. https://powercuts.nationalgrid.co.uk/CF34FD

4. resolved Nov 04, 2024, 02:28 PM UTC

   Western Power have now marked the incident as resolved

Read the full incident report →