Instaclustr incident
Increased Failure Rate of Apache Cassandra Backups
Resolved after 4 days 5 hours, affecting Management Console and Cluster Management API, on April 17, 2025.
We have seen a consistent reduction in errors rates from Apache Cassandra backup events over the past 3 days, however, we will continue to closely monitor. We expect to provide another update in the next 24 hours.
Affected components
Update timeline
- investigating Apr 17, 2025, 01:29 AM UTC
We are currently seeing an elevated rate of Backup Failures for AWS nodes for our Apache Cassandra offering. Currently we are expecting that these backups will continuously retry and eventually succeed, however this will be visible in the Instaclustr console and APIs as failed backup events. We are actively monitoring and working on a solution to this, and will provide more updates as investigation continues. If you have any questions or concerns please reach out via [email protected]
- identified Apr 17, 2025, 10:58 PM UTC
The issue has been identified and we are preparing to rollout a fix.
- monitoring Apr 18, 2025, 12:01 AM UTC
We have started rolling out a fix, this is expected to take a few hours to be applied to all Apache Cassandra nodes, we will be monitoring the progress and effectiveness of the rollout closely.
- monitoring Apr 18, 2025, 02:38 AM UTC
A fix has been deployed to all Apache Cassandra nodes. Initial results indicate the problem has been resolved, however, we will continue to closely monitor. We expect to provide another update in the next 24 hours.
- monitoring Apr 18, 2025, 10:29 PM UTC
We are continuing to observe a reduction in errors rates from Apache Cassandra backup events, however, we will continue to closely monitor. We expect to provide another update in the next 24 hours.
- monitoring Apr 19, 2025, 09:49 PM UTC
We are continuing to observe a reduction in errors rates from Apache Cassandra backup events, however, we will continue to closely monitor. We expect to provide another update in the next 24 hours.
- monitoring Apr 20, 2025, 09:47 PM UTC
We have seen a consistent reduction in errors rates from Apache Cassandra backup events over the past 3 days, however, we will continue to closely monitor. We expect to provide another update in the next 24 hours.
- resolved Apr 21, 2025, 07:15 AM UTC
This incident has been resolved.
Your product runs on more than Instaclustr
Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.
Amazon Web Services