Performance issues with Visual Studio Team Services – 02/28 – Resolved

Update: Tuesday, 28 February 2017 17:39 UTC This is a retroactive communication that users may have observed slowness or errors between 15:30 UTC to 16:00 UTC while accessing their VSTS accounts across all regions. We are still investing root cause to avoid any re-occurrence. As of right now Visual Studio Team Services is working as…


Performance issues with Visual Studio Team Services – 02/28 – Resolved

This is a retroactive communication that users should have observed slowness between 8:00 AM UTC to 11:10 AM UTC while accessing their VSTS accounts across all regions. We are doing a root cause analysis to avoid it from re-occurring. As of right now Visual Studio Team Services is responding as expected. We apologize for the…


Investigating Issues with Visual Studio Team Services – 02/27 – Resolved

Update: Tuesday, 28 February 2017 00:59 UTC The database upgrade took a bit longer than we expected but has completed.  We’ve confirmed that no more customer impact is occurring.  As stated below this issue was due to having too little capacity on this database after we completed a size downgrade.  We are always adjusting size on different databases…


Performance issues with Marketplace feature in Visual Studio Team Services – 02/27 – Mitigated

Users would have experienced slowness for ~40 minutes(2017-02-27 7:27 AM – 2017-02-27 8:09AM UTC) while accessing Marketplace site. This is due to the fact that Visual Studio 2015 IDE extension traffic was directed to Marketplace from VS Gallery, which lead to high number of requests getting queued on our web servers. We have reverted the change and…


Investigating issues with Visual Studio Team Services – 02/23 – Resolved

Update: Friday, 24 February 2017 18:59 UTC Hotfix has been deployed to all impacted scale units and we now confirm the issue is completely mitigated. Our customers now should not have any issues while using these extensions. We thank you for your patience through out this incident. Sincerely,Krishna Update: Friday, 24 February 2017 05:30 UTC…


Performance issues with Visual Studio Team Services in West Europe – 02/20 – Resolved

Update: Monday, 20 February 2017 14:49 UTC The issue is confirmed to be mitigated and customers in West Europe region should now not experience any slowness accessing their Visual Studio Team Services accounts. Our DevOps team continue to work on identifying the root cause of the issue to prevent any recurrence.  Sincerely,Chethan Update: Monday, 20…


Hosted Build issues with Visual Studio Team Services – 02/14 – Resolved

Update: Tuesday, 14 February 2017 19:38 UTC This incident has been mitigated as of 19:27 UTC. This is a re-occurrence of the incident from earlier today which has impacted a subset of users hosted in South Central US region. A bug has been identified which appears to be triggered during account restore process. This in…


Performance issues with Visual Studio Team Services – 02/13 – Resolved

Update: Monday, 13 February 2017 17:27 UTC The issue was mitigated at 15:10 UTC when the impacted front-end instance was taken out of rotation. The faulty host node has been set to ‘out for repair’ and with a special setting so that this node will not brought back into rotation automatically and it will need specific…


Performance issues with Visual Studio Team Services in North Central US Region- 02/13 – Resolved

Update: Monday, 13 February 2017 12:26 UTC Root cause has been isolated to high CPU utilization on one of the collection database which was impacting VSTS users hosted on the database. To address this issue we have failed over the database. Visual Studio Team Services in North Central US region is now working as expected….