Essential to TIA’s test selection is the map of dynamic dependencies between test methods and source files of code exercised during their execution. TIA needs dependencies mapped in this form: TestMethod1 dependency1 dependency2 TestMethod2 dependency1 dependency3 TIA can generate such a dependencies-map for managed code execution. Where such dependencies reside in .cs and .vb files,... Read More
At its core, TIA collects, and subsequently consults, a map of the dynamic dependencies of each test method as it is executing. As the test method is executing it will cover various methods – the source file in which those methods reside are the dynamic dependencies that get tracked. So, the mapping ends up like the following:... Read More
The previous post introduced how – for a given code commit – TIA will select and run only the relevant tests required to validate that commit. Thus, without sacrificing quality, both the testrun and its enclosing CI definition will complete faster. Here is how that translated to reality for one of our teams: The top... Read More
Continuous Testing in DevOps In older testing strategies, large software changes were tested as a complete product after a so called “release to QA”, running almost all tests just before release. We know the downsides to that. On the other hand, DevOps is all about a fast development to delivery pipeline and continuous delivery of... Read More
With the Team Foundation Server 2017 now available, TFS administrators will be planning to upgrade their existing TFS installations to this new version. As admins plan this activity, we wanted to discuss an important TFS database schema improvement that is rolling out with TFS 2017. What is the change? With TFS 2017, the test results... Read More
Having executed a test – at a minimum – we want to know the outcome. But beyond that, we may want to know more. Data collectors and loggers are the key extension mechanisms intended to provide this and other such details for rich reporting. Data collectors and loggers generate information based on listening to events... Read More
Updating off pre-RTM bits once RTM ships ought to be routine. But if you have not already done so in the case of the .NET Core based Test projects, let me give you a reason to do so. vstest delegates discovery and execution of tests to test-framework-specific adapters. Adapters indicate the kind of test containers... Read More
Every now and then we hear of a business-critical app failing during major promotional or seasonal events such as holiday sales. More often than not it turns out that the app is not ready for the massive demand created on such occasions – causing the servers to fail and resulting in dissatisfied customers and lost... Read More
Performance/load testing of Azure web applications is supported for a while, today we are announcing support for multiple URLs performance testing using Visual Studio web test format. Typically web application includes multiple web pages with headers and query parameters, so currently user has to create multiple test runs in Azure portal for testing each of... Read More
Over the last few months, there has been a consistent ask for Visual Studio Team Services (VSTS) / Team Foundation Server (TFS) Testing Tools roadmap. I would like to share our strategic direction, what we have delivered over the last 6 months and where we are headed. It would be great to get your feedback... Read More