Investigating issues with hosted build agents in South Central US – 03/29 – Mitigated

Final Update: Thursday, March 29th 2018 08:35 UTC We’ve confirmed that all systems are back to normal as of March 29th 2018 08:00 UTC. We have collected necessary logs and recycled the web role instances which mitigated the issue. Our logs show the incident started on 03/28 14:30 UTC.Sorry for any inconvenience this may have…


Investigating issues email notifications for new account sign up and other account level operations – all regions – 03/24 – Mitigated

Final Update: Saturday, March 24th 2018 13:09 UTC We’ve confirmed that all systems are back to normal as of 11:44 UTC. Our logs show the incident started on 2018/03/24 23:46 UTC and that during the 12 hours and 02 minutes that it took to resolve the issue. During the impact time, customer experience delay in…


Slow Build Commands in West Europe – 03/19 – Mitigated

Final Update: Monday, March 19th 2018 16:38 UTC We’ve confirmed that all systems are back to normal as of 2018-03-19 15:00Z UTC. Our logs show the incident started on 2018-03-19 14:00 UTC and that during the 1 hour and 0 minutes that it took to resolve the issue, <1% of customers experienced slowness for build…


Breaking Changes in my.visualstudio.com and manage.visualstudio.com – 03/16 – Resolved

Final Update: Friday, 16 March 2018 19:12 UTC We’ve confirmed that all systems are back to normal as of March 16th at 19:06 UTC. Our logs show the incident started on March 16th at 2:21 UTC and that during the 17 hours that it took to resolve the issue all customers experienced failed page loads…


Performance Degradation in West Europe – 03/14 – Mitigated

Final Update: Wednesday, March 14th 2018 15:03 UTC We’ve confirmed that all systems are back to normal as of 14:35 UTC. Our logs show the incident started on 12:20 UTC and that during the 2 hours and 15 minutes that it took to resolve the issue customers experienced slow or failed queries in the Western…