New STPCon talk coming up: Create Your Roadmap to Data-Driven Quality

I will once again have the pleasure of speaking at STPCon.   Hope you can make it! 101 :  Create Your Roadmap to Data-Driven Quality Tuesday, 10:30am – 11:45am Track: Test Strategy, Process and Design Bing analyzes Petabytes of data per day. Facebook instruments everything. Outlook.com analyzes web performance for millions of real users. Why? Because…

0

The return of A-Z Testing in Production – STPCon Fall 2012

Download the Slide Deck: PPT PDF The folks at STPCon had asked me to give an encore presentation of my March 2012 talk A to Z Testing in Production: TiP Methodologies, Techniques, and Examples. The new talk has some substantial updates including more focus on the use of Big-Data and a simplified categorization of test…

0

Testing in Production (TiP) – It Really Happens–Examples from Facebook, Amazon, Google, and Microsoft

  Testing in Production (TiP) really happens, and yes that it s a good thing! Here are some examples from Facebook, Amazon, Google, and Microsoft. The Methodologies This is not a complete list of TiP methodologies, but explains the ones used in the examples given A/B Testing (aka Online Controlled Experimentation): I explain this in…

0

Exposure Control: Software Services Peep Show

  It’s About Software Quality Not sure what you were expecting here at Your Software Has Bugs, but ignore that picture on the left, and learn how Exposure Control let’s you roll out dangerous software while minimizing risk to your users by giving them only a peep into the your new service. peep n.  a…

0

Service Deployments Should be Ramps, not Cliffs

[Going to try a mini-post…keeping it short and focused] In my previous post I introduced you to Online Experimentation.  The general use case for experimentation is to take two or more websites or services, each with different features or designs, and test them against each other using real users.  It is assumed that all the…

0

Don’t just listen to your users…watch them with Online Experiments

Online Controlled Experimentation (also known as A/B Testing) is a subject I will re-visit often as I am Test Manager for Microsoft’s Experimentation Platform (ExP) which enables properties at Microsoft to conduct such testing. We even have a shiny logo:   Guessing, Listening, and Watching To produce software that makes our customers giddy we need…

1