Postmortem – Intermittent Failures for Visual Studio Team Services on 14 Dec 2017

On 14 December 2017 we began to have a series of incidents with Visual Studio Team Services (VSTS) for several days that had a serious impact on the availability of our service for many customers (incident blogs #1 #2 #3). We apologize for the disruption these incidents had on you and your team. Below we…


Performance Degradation in West Europe – 12/22 – Mitigated

Final Update: Friday, December 22nd 2017 05:10 UTC We’ve confirmed that all systems are back to normal as of December 22nd 03:50 UTC. Our logs shows that the incident started on December 22nd 03:30 UTC and that during the 20 minutes that it took to resolve the issue customers experienced slow performance and failures while…


Performance Degradation in Central US – 12/20 – Mitigated

Final Update: Wednesday, December 20th 2017 16:08 UTC We’ve confirmed that all systems are back to normal as of December 20th 15:35 UTC. Our logs show the incident started on 15:05 UTC and that during the 30 minutes that it took to resolve the issue customers may have experienced slow and failed commands in the…


Postmortem – Availability issues with Visual Studio Team Services on 6 Dec 2017

On 6 December 2017 we had a global incident with Visual Studio Team Services (VSTS) that had a serious impact on the availability of our service (incident blog here). We apologize for the disruption. Below we describe the cause and the actions we are taking to address the issues. Customer Impact This was a global…


Postmortem – Availability issues with Visual Studio Team Services on 21 November 2017

On 21 November 2017 we had an incident with Visual Studio Team Services (VSTS) that had a serious impact on the availability of our service for many customers (incident blog here). We apologize for the disruption. Below we describe the cause and the actions we are taking to address the issues. Customer Impact This incident…


Intermittent performance degradation and failures in South Brazil region – 12/15 – Mitigated

Final Update: Friday, December 15th 2017 23:40 UTC We’ve confirmed that all systems are back to normal as of 19:40 UTC after the additional capacity has been added to our application tiers. During the incident, customers in South Brazil might have experienced degraded performance. We will continue to work with partners in Azure to fully…


Search failures for accounts hosted in the US region – 12/14 – Mitigated

Final Update: Friday, December 15th 2017 18:35 UTC This incident is now resolved. We have confirmed that all accounts which have installed the search extension are being indexed appropriately and no new accounts will run into this state. Indexing is a constant process that keeps search results up to date and the current state of…


Postmortem – Availability issues with Visual Studio Team Services on 16 November 2017

On 16 November 2017 we had a global incident with Visual Studio Team Services (VSTS) that had a serious impact on the availability of our service (https://blogs.msdn.microsoft.com/vsoservice/?p=15526). We apologize for the disruption. Below we describe the cause and the actions we are taking to address the issues. Customer Impact This was a global incident that…


Performance Degradation in South Central US – 12/12 – Mitigated

Final Update: Tuesday, December 12th 2017 21:15 UTC We’ve confirmed that all systems are back to normal as of December 12th 20:47 UTC. Our logs show the incident started on December 12th 20:32 UTC and that during the 15 minutes that it took to resolve the issue customers experienced slow performance and failures while using…