Mobility Route - Degraded system response on region server – Incident details

Web Portal experiencing major outage

Degraded system response on region server

Resolved
Degraded performance
Started 9 months agoLasted 1 day

Affected

Mobility Route App

Degraded performance from 6:25 PM to 6:29 PM, Operational from 6:25 PM to 6:29 PM, Degraded performance from 6:29 PM to 7:09 PM, Operational from 7:09 PM to 6:25 PM

Web Portal

Operational from 6:25 PM to 6:29 PM, Degraded performance from 6:29 PM to 7:09 PM, Operational from 7:09 PM to 6:25 PM

Mobile App

Degraded performance from 6:25 PM to 7:09 PM, Operational from 7:09 PM to 6:25 PM

Updates
  • Resolved
    Resolved
    This incident has been resolved.
  • Monitoring
    Monitoring

    We implemented a fix and are currently monitoring it while we await information from our third party regarding a full resolution. Our own fix will also help ensure this issue is mitigated in the future should our service partner have any similar issues that would result in undue taxing of our system resources.

    Thank you everyone for your patience.

  • Identified
    Identified

    We have identified the issue and are working to alert one of our third party service providers. In the meantime our engineers are deploying our own mitigation to avoid the system impacts that are overtaxing one of our key nodes. This is why a segment of our customers faced slow response times by the web portal and mobile applications.


    Our engineers expect to have this implemented by 3pm eastern time (12pm pacific). Thank you for your patience.

    This issue is not related to any of the ongoing updates to the mobile app as some users were assuming by statements made in support tickets. Users are encouraged to continue updating to the latest version, which as of today is 0.2.19

  • Update
    Update

    Our engineers are asking that web portal users experiencing slowdowns to not continue to repeatedly spam/attempt to perform actions more than once as this may be adding to the issues by causing an unnecessary increase with limited system response. Please be patient when performing actions with the understanding that it may be slow to respond at this moment.

  • Investigating
    Investigating

    We are currently investigating an issue with one of our nodes that is causing some degraded system response. Please note that this situation does not require any further support tickets and does not qualify as an "emergency" support ticket. We will continue to keep our users updated. If this particular issue does not impact you at the moment, you can disregard it.

    Thank you for your patience as we continue to investigate and identify the core issue in coordination with our service providers.