Experiencing Data Gaps for Many Data Types – 05/03 – Resolved


Final Update: Wednesday, 03 May 2017 20:09 UTC

We’ve confirmed that all systems are back to normal with no customer impact as of 05/03, 19:05 UTC. Our logs show the incident started on 05/03, 08:50 UTC and that during the 10 hours that it took to resolve the issue less than 1% of customers experienced Data Gaps.
  • Root Cause: The failure was due to network issues in underlying infrastructure.
  • Lessons Learned: Full RCA is pending from infrastructure team. Additional monitors had been put in place to make sure such issues are discovered and mitigated much faster in the future.
  • Incident Timeline:  10 Hours & 15 minutes – 05/03, 08:50 UTC through 05/03, 19:05 UTC

We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Vitaliy


Update: Wednesday, 03 May 2017 18:50 UTC

We continue to investigate issues within Application Insights. Root cause is not fully understood at this time. Some customers continue to experience very small Data Gaps when viewing Application Insights data. We are working to establish the start time for the issue, initial findings indicate that the problem began at 05/03 ~8:00 UTC. We currently have no estimate for resolution.
  • Work Around: none
  • Next Update: Before 05/03 23:00 UTC

-Vitaliy


Initial Update: Wednesday, 03 May 2017 16:09 UTC

We are aware of issues within Application Insights and are actively investigating. Some customers may potentially experience very small Data Gaps when viewing Application Insights data.
  • Work Around: none
  • Next Update: Before 05/03 18:30 UTC

We are working hard to resolve this issue and apologize for any inconvenience.
-Vitaliy


Skip to main content