Thinking About ROI for Test Automation

After we shipped Team Foundation Server 2010, I took on a new role on the TFS team as a Test Architect.  I’m excited about this role because it’s a little more hands-on than being a manager and because I get to help tackle some of the most challenging test problems we have across the product….


Mining Work Items for Opportunities to Improve Your Engineering Process

One of the things I spend a lot of time doing as a test manager is mining for interesting data in our work item tracking system (TFS of course).  For example, this morning, I went through a query of bugs that had been resolved as “won’t fix” but were also marked as regressions from previous…


QA Team Values for Team Foundation Server

My QA manager colleague and I have been working on our QA metrics process for the Team Foundation Server test organization.  This has been a fascinating process, and I wanted to give out a little insight into how we’re thinking about the problem. We have 2 different metrics processes focused on 2 different entities:  1)…


Learning about product and team metrics

Metrics are a double-edged sword.  On one hand, you can’t improve what you don’t measure.  On the other hand, if your metrics program is implemented poorly, you can end up with all sorts of problems ranging from fooling yourself into thinking everything’s ok to demotivating your team to information overload.  In any product development environment,…