Which comes first, the Process or the Tool?

Prologue I was just going through my email and came across a question on one of our discussion aliases that asked if it was possible to deliver an ALM assessment for a customer without worrying about the tool set they currently use. The customer wanted to have the assessment focus on their process. The person…

0

How Does the User Pacing model differ from the Number of Tests Started model

In my post on User Load Profiles, I talked about choosing one of two different load models, based on a couple of the options in Visual Studio. However, I have still received a lot of requests to clarify these two models and to show how I can apply one of the models to the testing…

0

Test And Attack – The Art of Testing WITH…

My old team coined a phrase that they use to describe their Performance engagements called “Test and Attack.” It is meant to conjure up a picture that can represent exactly what happens during the execution phase of a performance tuning and optimization engagement. So what does happen? Test With You, Not For You We refer…

0

LTP – Real World Example: Calculating Work Load From Historical Data

Recently, I saw a question on an internal alias that spawned a very useful dialog I wish to share below. This example shows how I approach calculating the work load and load pattern when using a mix of historical data and the need to project future data. Below is the relevant part of the email…

0

All About Load Test Planning (Part 5-Load Profile Additional Considerations)

In the previous post, I showed you how to come up with the profiles to use in a test as well as the numbers to plug into the profile. I also showed two fairly simple examples of load profiles that you might generate. In this post, I will show you some more examples of profiles,…

1

All About Load Test Planning (Part 4-Building the Load Profile)

Let’s start off with a review of this series. In the first post, we set our goals and objectives and defined the “purpose” of our testing. In the next post, we looked at data considerations that are independent of our goals, but still need to be considered. In the third post, we laid out the…

1

All About Load Test Planning (Part 3-Proper Use Cases and Scenarios)

PART 3 in a series of posts on Load Test Planning As of this point, we should have well defined Goals, Objectives and success criteria (part 1) and we should have an idea of how we want to consider building our data (part 2). Now we want to lay out the basic scenarios and use…

5

All About Load Test Planning (Part 2-Load Patterns and Data Considerations)

PART 2 in a series of posts on Load Test Planning In my previous post, I talked about the importance of goals, objectives and success criteria. Now that we have that information together, we can consider the next part, which is going to be defining the style of test that I want to use (NOTE:…

2

All About Load Test Planning (Part 1–Introduction)

PART 1 in a series of posts on Load Test Planning Introduction As part of my work inside Microsoft, I have to interface with several different groups of people, from sales to account management to the technical delivery people, and also to different product group teams. I have learned some very valuable lessons from these…

1

"Extrapolation, Educated Guesses and Dart Boards, Oh My"

Here is another common question in the testing world: “What is the best way to take the results from our tests with a small load and estimate how the system will behave under a full load?” There are many different reasons for asking this question, not the least of which is because testers often do…

0