Experiencing Data Latency for Many Data Types – 9/11 – Resolved


Final Update: Friday, 9/11/2015 04:04 UTC

We’ve confirmed that all systems are back to normal with no customer impact as of 9/11, 04:00 UTC. Our logs show the incident started on 09/10, 18:45 UTC and that during the 9 hours that it took to resolve the issue some of our customers experienced latency when accessing data.

Root Cause: The failure was due to memory issue in our system. 
Lessons Learned: Full RCA pending.we are working to capture more deeper diagnostics to aid in quicker resolution.
Incident Timeline: 9 Hours, 15 mins  – 9/10, 18:45 UTC through 9/11, 04:00 UTC.

We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Application Insights Service Delivery Team


Update: Friday, 9/11/2015 02:01 UTC

Our DevOps team continues to investigate issues within Application Insights. Root cause is not fully understood at this time. Some customers continue to experience data latency. We are working to establish the start time for the issue, initial findings indicate that the problem began at 09/10 ~23:00 UTC. We currently have no estimate for resolution.

Next Update: Before 9/11 04:00 UTC

-Application Insights Service Delivery Team


Initial Update: Friday, 9/11/2015 00:11 UTC

We are aware of issues within Application Insights and are actively investigating. Some customers may experience Data Latency. The following data types are affected: Metric, Request,Exception.

Next Update: Before 2:00 AM UTC

We are working hard to resolve this issue and apologize for any inconvenience.

-Application Insights Service Delivery Team

 

 
 


Skip to main content