Imported accounts experiencing 404s and/or are missing features in all regions – 07/20 – Mitigated


Final Update: Friday, July 20th 2018 19:34 UTC

We’ve confirmed that all systems are back to normal as of 2018-07-20 19:27 UTC. This was due to a recent change introduced in the Visual Studio Marketplace service which impacted the extensions of imported accounts.

During this incident, customers that recently imported their accounts using Data Import service (both Production and Dry Run) noticed few built-in default extensions such as Users, Release, Extensions missing were non functional. Features such as Code, Work, Build and User Hub were unaffected during this time.

Sincerely,
Sri Harsha


Update: Friday, July 20th 2018 18:50 UTC

Our DevOps team continues to investigate issues with imported accounts notice 404s errors and/or are missing built-in extension features like Releases, Users, Extensions. Root cause is not fully understood at this time, though it is suspected to be an issue with Marketplace service returning empty list of built-in extensions. We are attempting to mitigate the issue by reverting a recent deployment change in Marketplace service and verify it resolves the issue.

  • Work Around: None
  • Next Update: Before Friday, July 20th 2018 21:00 UTC

Sincerely,
Manohar


Update: Friday, July 20th 2018 15:51 UTC

Our DevOps team continues to investigate issues with imported accounts experiencing 404s and/or are missing features. Root cause is not fully understood at this time, though it is suspected to be a cache issue with how we handle built-in extensions. The problem began at 2018-07-17 14:20 UTC. We are attempting to mitigate the issue by forcing the bad cache entry to be evicted while we investigate how to prevent this issue permanently.

  • Work Around: None
  • Next Update: Before Friday, July 20th 2018 18:00 UTC

Sincerely,
Dexter


Initial notification: Friday, July 20th 2018 14:47 UTC

We’re investigating an issue with the TFS Database Import Service. Imported accounts are experiencing 404s when trying to access certain experiences and some others are reporting features like release management are missing. The scope of this impact is still be investigated, but it’s potentially impacting all import regions.

Given this, we’re suspending new imports as we investigate. We’ll provide updates as we make progress on the investigation. Once this issue has been resolved, we’ll start allowing new imports.

  • Next Update: Before Friday, July 20th 2018 15:20 UTC

Sincerely,
Dexter

Edit: Additional clarifications


Skip to main content