Upstash incident

Connectivity Issues in us-east-1

Resolved after 13 minutes, affecting N. Virginia, USA (us-east-1), on August 18, 2025.

postmortem Aug 18, 2025, 01:30 PM UTC

Between 12:37 UTC and 12:50 UTC, an overload in the connection proxying system resulted in instability for a subset of databases. The root cause was identified as a misconfiguration in the routing rules, which caused certain requests to experience timeouts during the initial phase of a gradual deployment. Upon detection, the deployment was immediately rolled back, restoring normal service. We are reviewing our deployment and configuration validation processes to prevent similar issues in the future.

Started
Aug 18, 2025, 12:37 PM UTC
Resolved
Aug 18, 2025, 12:50 PM UTC
Duration
13m
Detected by Pingoru
Aug 18, 2025, 12:37 PM UTC

Affected components

N. Virginia, USA (us-east-1)

Update timeline

  1. resolved Aug 18, 2025, 01:30 PM UTC

    Between 12:37 UTC and 12:50 UTC, an overload in the connection proxying system resulted in instability for a subset of databases. The root cause was identified as a misconfiguration in the routing rules, which caused certain requests to experience timeouts during the initial phase of a gradual deployment. Upon detection, the deployment was immediately rolled back, restoring normal service. We are reviewing our deployment and configuration validation processes to prevent similar issues in the future.

  2. postmortem Aug 18, 2025, 01:30 PM UTC

    Between 12:37 UTC and 12:50 UTC, an overload in the connection proxying system resulted in instability for a subset of databases. The root cause was identified as a misconfiguration in the routing rules, which caused certain requests to experience timeouts during the initial phase of a gradual deployment. Upon detection, the deployment was immediately rolled back, restoring normal service. We are reviewing our deployment and configuration validation processes to prevent similar issues in the future.

Your product runs on more than Upstash

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →