ClickHouse incident

Degraded connectivity affecting us-east-2

Resolved after 1 day 7 hours, affecting us-east-2 and us-east-2, on April 28, 2026.

monitoring Apr 28, 2026, 10:32 PM UTC

A subset of services in us-east-2 experienced intermittent connection timeouts earlier today caused by exhaustion of network resources on one of our regional load balancers. We have applied mitigations to restore connectivity and the service is currently operating normally. We are continuing to work with on rolling out additional capacity and safeguards to prevent recurrence. Customers who continue to see connection issues should reach out to support.

Started
Apr 28, 2026, 06:44 PM UTC
Resolved
Apr 30, 2026, 02:12 AM UTC
Duration
1d 7h
Detected by Pingoru
Apr 28, 2026, 06:44 PM UTC

Affected components

us-east-2us-east-2

Update timeline

  1. investigating Apr 28, 2026, 06:44 PM UTC

    We are currently investigating connection issues affecting some customers, resulting in connection timeouts when connecting to ClickHouse. The issue has been isolated to infrastructure in the us-east-2 region. We have received multiple high-severity reports and are treating this with priority. Our engineering team is actively working to mitigate the issue and restore normal connectivity. We will provide further updates as more information becomes available.

  2. monitoring Apr 28, 2026, 07:18 PM UTC

    The connection issues affecting some customers in the us-east-2 region have been mitigated, and services are currently operating normally. We are continuing to monitor the situation closely to ensure stability and prevent recurrence. We will provide further updates if there are any changes.

  3. resolved Apr 28, 2026, 07:41 PM UTC

    The connection issues affecting some customers in the us-east-2 region have been resolved, and services are operating normally.

  4. investigating Apr 28, 2026, 08:34 PM UTC

    We are seeing a recurrence of the connection issues affecting some customers in the us-east-2 region, resulting in connection timeouts. Our team is actively investigating and working to mitigate the issue as a priority. We will provide further updates as more information becomes available.

  5. monitoring Apr 28, 2026, 10:32 PM UTC

    A subset of services in us-east-2 experienced intermittent connection timeouts earlier today caused by exhaustion of network resources on one of our regional load balancers. We have applied mitigations to restore connectivity and the service is currently operating normally. We are continuing to work with on rolling out additional capacity and safeguards to prevent recurrence. Customers who continue to see connection issues should reach out to support.

  6. resolved Apr 30, 2026, 02:12 AM UTC

    We have resolved the incident.

Your product runs on more than ClickHouse

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →