Licensing Issues in multiple VSTS accounts – 12/07 – Mitigated


Final Update: Friday, December 8th 2017 16:38 UTC

We’ve confirmed that all systems are back to normal as of December 8th 2017 12:12 UTC. Our logs show the incident started on November 29th 2017 12:19 UTC. and that during that time users may have noticed the access levels of users in their accounts are being downgraded to 'Stakeholder'.
Sorry for any inconvenience this may have caused.

  • Root Cause: The failure was due to a bug introduced in recent deployment.
  • Chance of Re-occurrence: Low
  • Incident Timeline: November 29th 2017 12:19 UTC through December 8th 2017 12:12 UTC

Sincerely,
Ariel Jacob


Update: Friday, December 8th 2017 13:14 UTC

The hotfix deployment completed in multiple VSTS regions. The remaining regions are in the process of being rolled out. We are closely monitoring the progress and will update this post within next 6 hours.

  • Next Update: Before Friday, December 8th 2017 19:30 UTC

Sincerely,
Ariel Jacob


Update: Friday, December 8th 2017 07:45 UTC

The hotfix deployment is currently being rolled out across all VSTS production scale units. This fix is taking more than expected time. We are closely monitoring the progress and will update this post within next 6 hours.

  • Next Update: Before Friday, December 8th 2017 13:45 UTC

Sincerely,
Shubhra


Update: Friday, December 8th 2017 01:33 UTC

The hotfix deployment to resolve this issue is currently in the process of rolling out across all VSTS production scale units. We are closely monitoring the progress and will update this post within the next 6 hours with an updated status.

  • Next Update: Before Friday, December 8th 2017 07:45 UTC

Sincerely,
Sri Harsha


Update: Thursday, December 7th 2017 19:51 UTC

We have identified a fix and are in the process of rolling it out across the service.

Sincerely,
Sri Harsha


Initial Update: Thursday, December 7th 2017 18:51 UTC

We're investigating reports of licensing issues in the service. Users may notice the access levels of users in their accounts are being downgraded to 'Stakeholder'.

  • Next Update: Before Thursday, December 7th 2017 19:25 UTC

Sincerely,
Sri Harsha


Skip to main content