Datacake - Data processing delays – Incident details

Data processing delays

Resolved
Degraded performance
Started 4 months agoLasted about 8 hours

Affected

Web Application
MQTT Server
Reports
Outgoing Webhooks
Updates
  • Resolved
    Resolved

    All queues have now finished processing and are operating in real-time. Thank you for your patience.

  • Monitoring
    Monitoring

    We are pleased to report that almost all important queues have caught up and are now processing data in real-time. The MQTT publish queue is still slightly behind, and we are working to resolve this.

  • Update
    Update

    The main affected queue has been successfully processed. However, due to the high volume of data, some secondary queues, such as MQTT and database insertion, are experiencing high load. Data delays are still occurring, and we are actively managing this to minimize impact.

  • Identified
    Identified

    We have identified delays in data processing due to an overloaded queue and have already scaled up our processing power for faster performance. Our team is closely monitoring the queue to ensure it is cleared efficiently.

  • Investigating
    Investigating

    Our system is experiencing processing delays. No data has been lost, and the system should be caught up shortly.