Skip to main content

Performance Testing 101

So one of my objectives is to be able to offer more in regards to Performance Testing.

Whilst I understand the basics, I figured I'd write them down and start a series of blog posts hopefully detailing my findings and explaining why performance testing is important, and the different types of performance testing.

In order to understand why performance testing is important, it will be good to know some of the more popular types of performance testing are....

Load Testing
This is testing a system to understand and analyse the behaviour of a system under a specific expected load. This is probably the most common form of performance testing, it is useful in identifying any bottlenecks in a piece of software. 

Stress Testing
This is testing a system to breaking point, so that you can understand the point at which the system fails and under what load.

Endurance Testing
Similar to load testing, but this will be load under a prolonged period of time, in order to gain confidence that the system can perform under loads for a long period and measuring the performance of the system.

Spike Testing
This is achieved by a sudden increase in load against a system, to make sure that it can handle the sudden increase in users, an example would be of a new system going into production that suddenly has to deal with a huge influx of users.

When might you use one of the above?
Now you have a basic understanding of some of the different types of performance testing, we can now look at where they may be useful, and when you might consider doing one of the above.

Load Testing is possibly one of the more well known and what often gets confused as Performance Testing full stop, when someone mentions performance testing, it is often assumed that they are talking about load testing, however, unless we dig deeper, assuming something like that can make an ass out of you and me...

Anyway, I digress, Load Testing would be useful when there is a change to the system that can cause there to be an increased amount of load, for instance we recently changed data types from VARCHAR to NVARCHAR, this meant there was double the amount of data being stored in databases and being used in any database call, so we decided its important to do some forms of load testing on the front end, as well as the back end on the SPROCs themselves.

Stress Testing is useful to identify what your system is able to cope with, for example, if you were expecting X number of visitors during a certain period of time, if you know what your break point is, with regards to stress testing, you can safely say that the system can perform under the expected load and then some.

Endurance Testing is useful in identifying memory leaks in a system, if you expect the system to be under heavy loads for a prolonged period of time, it is essential to perform endurance testing to identify any problems that may arise.

Spike Testing as mentioned above is useful when putting a new service live, as you expect a sudden increase in traffic once it goes into production and will be hit with a sudden influx of load.

So, there you have it, some basics about the different types of performance testing, and why it might be important in your project.... Going forward we'll investigate different toolsets for performing the above and when is the best time to do performance testing in an Agile project.

Comments

Popular posts from this blog

What is a PBI?

After my last post, I had the question of what is a PBI... so I thought i'd write a short blog post about what they are and why they are used.

A PBI is an acronym for Product Backlog Item. It is a description of a piece of work that your SCRUM team will develop and deliver. When you have a list of Product Backlog Items, you then refer to that collective list as a Product Backlog.

The product backlog is often prioritised and yourteam will work through each PBI, and release on a regular schedule... I am however going deep into the world of Agile development, which isn't entirely what this post is about, so I will stop myself now.

A Product Backlog Item is made up of the following:

Title - This is often a one liner that gives the team an idea of what the PBI is about, although it can just be an ID for the item and the team work off of that.

Description - Breaks down the PBI in a bit more detail, and can be written in any style, however I prefer it to be written as follows: 



By writin…

Dealing with Selenium WebDriver Driver.Quit crashes (Where chromedriver.exe is left open)

We recently came across a problem with Selenium not quitting the webdriver and this would then lock a file that was needed on the build server to run the builds.

We were using Driver.Quit() but this sometimes failed and would leave chromedriver.exe running. I looked around and found this was a common issue that many people were having. We (I say we, as we came to the solution through paired programming), came up with the following, that would encapsulate the driver.quit inside a task and if this task takes longer than 10 seconds, then it will clean up any processes started by the current process, in the case of the issue on the build server, it would kill any process started by Nunit.

[AfterTestRun]
        public static void AfterTestRun()
        {
            var nativeDriverQuit = Task.Factory.StartNew(() => Driver.Quit());
            if (!nativeDriverQuit.Wait(TimeSpan.FromSeconds(10)))
            {
                CleanUpProcessByInheritance();
            }
       }

        private s…

Advantages of using Test Management tools

Before I start talking about test management tools, let me clarify what I mean by the term test Management tools...  I am not taking about your office excel program where you store your test cases in. I'm talking about bespoke test Management tools, your quality centers or Microsoft test manager...
In the strict case of the term test Management tool, Microsoft Excel can be used as such, but heck, so could a notepad if used in the right way... For the sake of this blog post I am talking about bespoke test Management tools.
Firstly, what test tools are out there? There are many more out there today than when I first started in QA over 5 years ago. When I started the market was primarily dominated by a tool called Quality Center, this would run in a browser (only Ie unfortunately) and was hosted on a server.. Nowadays it's market share has somewhat dwindled, and there are some new kids on the block. 
One of the more popular tools is that of Microsoft Test Manager, it's big…