Nanonets incident

Delayed file processing for all models using async api

Resolved after 26 minutes, affecting API, on April 11, 2025.

postmortem Apr 11, 2025, 01:17 PM UTC

On April 11th, 2025, between 11:35 AM UTC and 12:45 PM UTC, users experienced delays in file processing across all models on the async prediction API of [app.nanonets.com](http://app.nanonets.com). There is no impact on EU and IN region. The issue was caused by an internal service dependency that became bottlenecked, leading to a backlog in the processing queue. The root cause was promptly identified, and a fix was deployed to restore normal processing. We sincerely apologize for the inconvenience caused and we are taking steps to prevent similar occurrences in the future.

Started
Apr 11, 2025, 12:44 PM UTC
Resolved
Apr 11, 2025, 01:10 PM UTC
Duration
26m
Detected by Pingoru
Apr 11, 2025, 12:44 PM UTC

Affected components

API

Update timeline

  1. investigating Apr 11, 2025, 12:44 PM UTC

    We are currently investigating this issue.

  2. identified Apr 11, 2025, 12:47 PM UTC

    The issue has been identified and a fix is being implemented.

  3. monitoring Apr 11, 2025, 12:59 PM UTC

    A fix has been implemented and we are monitoring the results.

  4. resolved Apr 11, 2025, 01:10 PM UTC

    This incident has been resolved.

  5. postmortem Apr 11, 2025, 01:17 PM UTC

    On April 11th, 2025, between 11:35 AM UTC and 12:45 PM UTC, users experienced delays in file processing across all models on the async prediction API of [app.nanonets.com](http://app.nanonets.com). There is no impact on EU and IN region. The issue was caused by an internal service dependency that became bottlenecked, leading to a backlog in the processing queue. The root cause was promptly identified, and a fix was deployed to restore normal processing. We sincerely apologize for the inconvenience caused and we are taking steps to prevent similar occurrences in the future.

Your product runs on more than Nanonets

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →