Zid incident

Intermittent Service Degradation

Resolved after 12 hours 29 minutes, affecting Stores and API, on February 18, 2026.

postmortem Feb 18, 2026, 06:25 PM UTC

The team released an incident fix for an issue where the count of products under categories was not calculated correctly, and was instead showing 0 for parent categories whose products are all placed inside child categories. As a result of this fix, there was an increase in DB queries, leading to a spike in CPU utilization of our database. This happened mainly due to cache warming jobs used in the old catalog system. While the fix was intended for the Dashboard, an inadvertent consequence happened on “Old Catalog” – not Vitrin \(stores on Vitrin were browsable safely\). During that period, some users who did not have the store cached on their end may have experienced downtime with some stores. Others experienced degraded performance only on cart actions. ‌ Action Taken: 1. We immediately reverted the troublesome deployment. 2. The congested queues for store cashing were purged to avoid having blocked jobs 3. Assembled a rapid response team to decouple this dependency and prevent such incidents in the future.

Started
Feb 18, 2026, 01:00 AM UTC
Resolved
Feb 18, 2026, 01:30 PM UTC
Duration
12h 29m
Detected by Pingoru
Feb 18, 2026, 01:00 AM UTC

Affected components

StoresAPI

Update timeline

  1. identified Feb 18, 2026, 05:59 PM UTC

    Some stores were experiencing slower than usual response times.

  2. monitoring Feb 18, 2026, 06:02 PM UTC

    A fix has been implemented and we are monitoring the results.

  3. resolved Feb 18, 2026, 06:03 PM UTC

    This incident has been resolved.

  4. postmortem Feb 18, 2026, 06:25 PM UTC

    The team released an incident fix for an issue where the count of products under categories was not calculated correctly, and was instead showing 0 for parent categories whose products are all placed inside child categories. As a result of this fix, there was an increase in DB queries, leading to a spike in CPU utilization of our database. This happened mainly due to cache warming jobs used in the old catalog system. While the fix was intended for the Dashboard, an inadvertent consequence happened on “Old Catalog” – not Vitrin \(stores on Vitrin were browsable safely\). During that period, some users who did not have the store cached on their end may have experienced downtime with some stores. Others experienced degraded performance only on cart actions. ‌ Action Taken: 1. We immediately reverted the troublesome deployment. 2. The congested queues for store cashing were purged to avoid having blocked jobs 3. Assembled a rapid response team to decouple this dependency and prevent such incidents in the future.

Your product runs on more than Zid

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →