Nanonets incident

RCA for Processing Delays for Instant Learning Models on app.nanonets.com – 04 Mar

Resolved after 2 hours 10 minutes, on March 4, 2026.

resolved Mar 05, 2026, 09:37 AM UTC

On 04th March between 11:00 AM and 1:10 PM UTC, we experienced a service degradation that affected Instant Learning models hosted on app.nanonets.com During this time window, the secondary database serving part of the processing workload experienced unusually high load. This temporarily reduced our overall processing capacity to approximately 50%. As a result Asynchronous uploads may have experienced increased response times and delayed file processing. Synchronous uploads may have encountered intermittent failures. Only Instant Learning models on app.nanonets.com were affected. Other model types and other regions remained fully operational. Our engineering team identified the source of the elevated database load and implemented corrective actions to stabilize the system. Processing capacity was restored and services returned to normal by 1:10 PM UTC. We are implementing additional optimizations to improve database performance and resilience. These improvements will be deployed over this week and will not require any downtime. We sincerely apologize for the inconvenience caused and appreciate your patience while we worked to resolve the issue. Please feel free to reach out if you have any questions.

Started
Mar 04, 2026, 11:00 AM UTC
Resolved
Mar 04, 2026, 01:10 PM UTC
Duration
2h 10m
Detected by Pingoru
Mar 04, 2026, 11:00 AM UTC

Update timeline

  1. resolved Mar 05, 2026, 09:37 AM UTC

    On 04th March between 11:00 AM and 1:10 PM UTC, we experienced a service degradation that affected Instant Learning models hosted on app.nanonets.com During this time window, the secondary database serving part of the processing workload experienced unusually high load. This temporarily reduced our overall processing capacity to approximately 50%. As a result Asynchronous uploads may have experienced increased response times and delayed file processing. Synchronous uploads may have encountered intermittent failures. Only Instant Learning models on app.nanonets.com were affected. Other model types and other regions remained fully operational. Our engineering team identified the source of the elevated database load and implemented corrective actions to stabilize the system. Processing capacity was restored and services returned to normal by 1:10 PM UTC. We are implementing additional optimizations to improve database performance and resilience. These improvements will be deployed over this week and will not require any downtime. We sincerely apologize for the inconvenience caused and appreciate your patience while we worked to resolve the issue. Please feel free to reach out if you have any questions.

Your product runs on more than Nanonets

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →