Experiencing Data Latency for Many Data Types – 04/27 – Resolved


Final Update: Thursday, 28 April 2016 03:53 UTC

We've confirmed that all systems are back to normal with no customer impact as of 4/28 03:35 UTC. Our logs show the incident started on 4/27, 16:40 UTC and that during the 10 hours & 55 that it took to resolve the issue some customers would have experienced data latency.
  • Root Cause: The failure was due to slow processing in one of our back end services.
  • Incident Timeline: 10 Hours & 55 minutes - 4/27, 16:40 UTC through 4/28 03:35 UTC

We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Steve


Update: Thursday, 28 April 2016 00:48 UTC

We are continuing to process the latent data. Customers will continue to experience data latency for the time period between 04/27 16:40 through 17:20 UTC.  We estimate 4 hours before all the latency is mitigated.
  • Work Around:  none
  • Next Update: Before 04/28 05:00 UTC

-Sapna


Update: Wednesday, 27 April 2016 20:42 UTC

Root cause has been isolated to slow processing in one of our back end services which is impacting multiple data types for a subset of customers. To address this issue we rebooted the affected services. A subset of customers will experience a window of data that is latent. Current data is not latent.
  • Work Around: None
  • Next Update: Before 04/28 01:00 UTC

-Steve


Initial Update: Wednesday, 27 April 2016 17:01 UTC

We are aware of issues within Application Insights and are actively investigating. Some customers may experience Data Latency. The following data types are affected: Customer Event,Dependency,Exception,Metric,Performance Counter,Request,Trace.
  • Work Around: None
  • Next Update: Before 04/27 21:30 UTC

We are working hard to resolve this issue and apologize for any inconvenience.
-Steve




Skip to main content