Experiencing Data Loss for Many Data Types - 5/7 - Resolved


Final Update: Thursday, 5/7/2015 22:39 UTC

We’ve confirmed that all systems are back to normal with no customer impact as of 5/7, 21:00 UTC. Our logs show the incident started on 5/7, 19:15 UTC and that during the 2 hours that it took to resolve the issue, a small percentage of our customers in West US would have faced very minor data loss (0.0004%) for all data types .

Root Cause: The failure was due to a special case that our application got into because of an edge case failure of our auto deployment service
Chance of Reoccurrence: Minimal
Lessons Learned: We are in the process of mitigating this and similar issues by redesigning the way in which our applications handle connections from clients.
Incident Timeline:  1 Hour & 45 minutes - 5/7, 19:15 UTC through 5/7, 21:00 UTC

We understand that customers rely on Application Insights as a critical service and apologize for any impact this incident caused.

-Application Insights Service Delivery Team


Initial Update: Thursday, 5/7/2015 21:17 UTC

We are aware of issues within Application Insights and are actively investigating. Some customers in West US region may experience very minor data loss. The following data types are affected: Customer Event, Dependency, Exception, Metric, Page Load, Page View, Performance Counter, Request, Trace.

Work Around: none
Next Update: Before 23:15 UTC

We are working hard to resolve this issue and apologize for any inconvenience.

-Application Insights Service Delivery Team

 

Skip to main content