Locomote incident

Workflow loading issue

Resolved after 1 hour 32 minutes, affecting Travel Management Platform, on March 18, 2025.

postmortem Mar 20, 2025, 02:01 PM UTC

We apologise for any disruption this caused by our recent partial outage, which affected workflow and report loading. The root cause of the issue was preparatory work recently put in place for planned future upgrades, which revealed a configuration mismatch between our production and development/test environments that allowed this issue to bypass both manual and automated testing. We’ve since adjusted our test environments to align with the production configuration in question, and confirmed the issue is now correctly caught in automated tests. We are confident this class of problem is now remediated.

Started
Mar 18, 2025, 09:59 PM UTC
Resolved
Mar 18, 2025, 11:31 PM UTC
Duration
1h 32m
Detected by Pingoru
Mar 18, 2025, 09:59 PM UTC

Affected components

Travel Management Platform

Update timeline

  1. identified Mar 18, 2025, 09:59 PM UTC

    The issue has been identified and a fix is being worked on.

  2. identified Mar 18, 2025, 10:14 PM UTC

    Workflow loading issue has been resolved. We're investigating a secondary issue with reporting access for admins.

  3. monitoring Mar 18, 2025, 11:31 PM UTC

    Reporting auth issue is now also resolved, we are monitoring for any further issues.

  4. resolved Mar 19, 2025, 12:02 AM UTC

    Reporting auth issue is now also resolved, we are monitoring for any further issues.

  5. postmortem Mar 20, 2025, 02:01 PM UTC

    We apologise for any disruption this caused by our recent partial outage, which affected workflow and report loading. The root cause of the issue was preparatory work recently put in place for planned future upgrades, which revealed a configuration mismatch between our production and development/test environments that allowed this issue to bypass both manual and automated testing. We’ve since adjusted our test environments to align with the production configuration in question, and confirmed the issue is now correctly caught in automated tests. We are confident this class of problem is now remediated.

Your product runs on more than Locomote

Add the vendors you depend on and get one message when any of them reports trouble. Free for 3 vendors, no card.

Add your stack →