Experiencing Data Latency for Many Data Types – 04/26 – Resolved


Final Update: Tuesday, 26 April 2016 10:30 UTC

We’ve confirmed that all systems are back to normal with no customer impact as of 04/26 10:10 UTC. Our logs show the incident started on 04/26 06:40 UTC and that during the 3 and a half hours that it took to resolve the issue customers experienced multiple windows of data latency.
  • Root Cause: The failure was due to slowdown in our service. We are doing further root cause in order to make our services more resilient in the future.
  • Lessons Learned: We continue to work and research ways to make our system more resilient so that this does not happen as often in the future.
  • Incident Timeline: 3 Hours & 30 minutes – 04/26 06:40 UTC through 04/26 10:10 UTC

We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Varun


Update: Tuesday, 26 April 2016 08:57 UTC

Root cause has been isolated to slow processing in a back-end service which was impacting multiple data types. We have taken the steps to mitigate the issue. Current Data processing is working as expected. Backlog data is processing at a healthier rate Some customers may experience data gaps outside of 2 hour SLA for the data ingested between 06:40 AM and 07:40 AM UTC .
  • Work Around: None
  • Next Update: Before 04/26 13:00 UTC

-Varun


Skip to main content