Issues with Hosted Build Service in Europe – 05/30 – Mitigated

Final Update: Tuesday, May 30th 2017 17:31 UTC We’ve confirmed that all systems are back to normal as of 17:09 UTC, Our logs show the incident started on 30 May 2017 13:21 UTC. We have the long build queue wait times due to the Azure VM allocation issues. We worked with Azure team and mitigated…


Performance Issues with Visual Studio Team Services – 05/29 – Mitigated

Final Update: Monday, May 29th 2017 15:10 UTC We’ve confirmed that all systems are back to normal as of May 29th 2017 14 UTC. We have observed slowness connecting to one of the collection database hosted in South Brazil region and hence customers might have experienced slowness while working on VSTS accounts hosted in this…


Issues while accessing Visual Studio Team Services through Firefox browser – 05/29 – Mitigated

Final Update: Monday, May 29th 2017 18:55 UTC Firefox users may have experienced errors when trying to use Visual Studio Team Services. A fix has been implemented across our environment. Sorry for any inconvenience this may have caused. Root Cause: The failure was due to stale caches causing login errors. Users may have seen the…


Issues with Visual Studio Team Services – 05/26 – Resolved

Final Update: Friday, 26 May 2017 20:34 UTC Hotfix was successfully deployed to SPS and resolved the issue. Root Cause: The failure was due to an SPS hotfix that was deployed yesterday Chance of Reoccurrence: Low Issue acknowledged as being resolved @ 10:21 UTC Rgds,Ian Update: Friday, 26 May 2017 18:49 UTC We have been able…


Postmortem: Authentication failures for Visual Studio Team Services on 5/10

Customer Impact: On Wednesday, 10 May 2017, approximately 5% of our users experienced failures when interacting with the service. The issue started at 19:32 UTC and lasted for 40 minutes. During this time, VSTS users experienced errors signing into VSTS or accessing new pages . The issue was mitigated at 20:12 UTC. What went wrong:…


Advisory – Planned Maintenance on VS Team Services – 05/20 – Complete

Maintenance is now complete. Users should now be able to create profiles, create accounts and set up Microsoft Teams integrations. — Maintenance is now starting. We will post an update when it is complete. — We will be performing planned maintenance on the service that handles account creation, profile creation and Microsoft Teams integration with…


Issues with Visual Studio Team Services – 05/18 – Mitigated

Final Update: Thursday, May 18th 2017 16:39 UTC We’ve confirmed that all systems are back to normal. At the peak of this incident, a small subset of users may have noticed slow progression of builds due to slowness in connecting to git sources. Sincerely,Sri Harsha Update: Thursday, May 18th 2017 15:29 UTC We are closely…


Issues with Visual Studio Team Services – 05/18 – Mitigated

Final Update: Thursday, May 18th 2017 14:55 UTC Further investigations revealed there was an issue with Azure Active Directory which may have impacted customers. Customers who have got this error (“AADSTS50000: There was an error issuing a token” message while logging into Visual Studio Team Services) should not see any issues further, as the issue…


Maintenance on Cloud Load Testing and Search services – Wednesday, 15 May – Completed

Final Update: Thursday, 18 May 2017 02:58 UTC Maintenance on Search service is now complete. Thanks for your patience during this time. Some customers may see few stale results until Search service catches up with all the code and work item updates missed during the maintenance window. Sincerely,Manjunath Update: Thursday, 18 May 2017 00:37 UTC…


Performance issues with Visual Studio Team Services in South Central US – 05/15 – Resolved

Update: Monday, 15 May 2017 17:27 UTC Between 15:30 and 16:00 UTC on Monday, 15 May 2017, a subset of users with VS Team Services accounts hosted in South Central US region may have experienced degraded performance. This has been isolated to a service deployment being performed at that time. Our post deployment health checks…