Service Deployments Should be Ramps, not Cliffs

[Going to try a mini-post…keeping it short and focused] In my previous post I introduced you to Online Experimentation.  The general use case for experimentation is to take two or more websites or services, each with different features or designs, and test them against each other using real users.  It is assumed that all the…

0

Don’t just listen to your users…watch them with Online Experiments

Online Controlled Experimentation (also known as A/B Testing) is a subject I will re-visit often as I am Test Manager for Microsoft’s Experimentation Platform (ExP) which enables properties at Microsoft to conduct such testing. We even have a shiny logo:   Guessing, Listening, and Watching To produce software that makes our customers giddy we need…

1

Feeling TiPsy…Testing in Production Success and Horror Stories

One topic I hope to return to many times in this blog is that of TiP, or Testing in Production.  For a good introduction to this check out Ken Johnston’s blog entry TIP-ING SERVICES TESTING BLOG #1: THE EXECUTIVE SUMMARY which is an updated version of the executive summary of the ThinkWeek paper that I…

3