Vital - Delays in visit updates – Incident details

All systems operational

Delays in visit updates

Resolved
Degraded performance
Started almost 2 years agoLasted about 2 hours

Affected

Vital Emergency

Operational from 5:40 PM to 5:40 PM, Degraded performance from 5:40 PM to 7:12 PM

AI Wait Times

Operational from 5:40 PM to 5:40 PM, Degraded performance from 5:40 PM to 7:12 PM

Labs & Imaging

Operational from 5:40 PM to 5:40 PM, Degraded performance from 5:40 PM to 7:12 PM

Patient Service Requests

Operational from 5:40 PM to 5:40 PM, Degraded performance from 5:40 PM to 7:12 PM

SMS

Operational from 5:40 PM to 5:40 PM, Degraded performance from 5:40 PM to 7:12 PM

Welcome & Invite SMS Messages

Operational from 5:40 PM to 5:40 PM, Degraded performance from 5:40 PM to 7:12 PM

Updates
  • Resolved
    Resolved

    The changes we implemented to clear the bottleneck in message processing improved throughput, messages in the backlog were processed, and new messages should no longer be delayed.

  • Monitoring
    Monitoring

    An unexpectedly large amount of messages sent into our systems lead to a bottleneck in the message processing, causing delays to all our customers. We have implemented rules to help clear this bottleneck, and are monitoring the situation closely.

  • Identified
    Identified

    We've identified the cause of the issue, and have taken actions to restore live processing of messages. Message queues are gradually draining, but updates may still be delayed.

  • Investigating
    Investigating

    We are currently investigating an issue with a delay in processing information relating to visit updates.