June 17, 2019
What is Regression Testing?
A technique adopted to validate the unmodified portions of a software product ensuring that no new bugs have arrived and that they remain intact and unaffected is known as regression testing. It can be classified as one of the software maintenance activities, which is carried out by selecting appropriate test selection algorithms, to reduce the time taken to test the changes that took place on account of feature addition or modification.
"Regression testing" can be a time consuming and lengthy process as it involves implementation of test cases for the whole program repeatedly unless we are sure that the software product is error free. The reason that a 'regression test selection' process is undertaken is due to the fact that a handful of test cases will actually serve the purpose of retesting the existing software to ensure that the portions of changes is not interfering with the unmodified sections of the application.
The test cases for 'regression testing' is chosen from among the list of scenarios that have been modified or updated recently. Test cases are thus prioritized as per requirements by applying a suitable regression test approach.
Software Maintenance Activities:
- Software Release and User Feedback - Once a software product is released, the software product is at the discretion of the end user. The user provides the necessary feedback regarding the functioning of the software product. Reports bugs and flaws, if any.
- Change Requirements - The next step is to figure out the areas of change, which portion of the program needs modifications and what amount of time needs to be invested.
- Changes in Code - It's now time for actually modifying the product in accordance with the change specifications laid down.
- Finding a Resolution -If any unresolved task remains at the developer's end with respect to the change requests, then those issues are addressed first.
- Regression Testing - Now we perform regression test on the modified portions of the software product and see if any bugs arise during this process, and hence we fix it.
The above sequence of activities is a process of processing, analyzing, and finding a solution to the software product.
Regression Test Selection:
This is a way of selecting the most appropriate test case to ensure that it delivers the correct result.It thus enables a tester to select a valid set of test cases to make sure the unmodified part of the program is error free.
So we can categorize the concept of test selection for regression testing into two broad categories:
- Identify the affected parts of the program - When a particular module is changed, other parts of the program are bound to be affected. It is time for the identification of bugs in the unmodified parts of the program.
- Test Case Selection -Involves a selection of "test cases" from an already defined "test suite".
Here we can state another interesting concept, that is, Test- Driven Development. This is a method of execution of test cases repeatedly, to ensure the right product is being built.
So if we try to define it in a bit more mathematical way, we can say, regression test selection comprises selecting a subset T' of the actual test suite T. Hence T' may contain few test cases {t1,t3,t4} , those test cases that will help us to manage our unmodified part of program.
There can be various approaches to test case selection. We may understand the concept by focusing on one of the many approaches.
For instance, we have a test suite T with test cases {t1,t2,t3,t4,t5}.
When applying regression testing, we may need the only {t1,t2} out of all the test cases, which are considered to solve our purpose.
Few Regression Test Selection Algorithms used:
- Safe - The first approach considers a regression test selection technique, which includes all those test cases which cover the modified methods at least once.
- Minimization - Selects minimum number of those test cases that execute all the modified portions.
- Random 25% - Selects 25% of the total number of test cases.
- Random 50% - Selects 50% of the total number of test cases.
- Random 75% - Selects 75% of the total number of test cases.
These selection techniques provide a very controlled environment for identifying the faults in a given program.
Regression test selection can further be categorised into three categories:
- Coverage Techniques: It is based on "coverage" criteria. These include coverable components for the modified portion if the program.
- Minimisation Technique: Works similar to a coverage technique however, it is based on the selection of a minimum number of test cases.
- Safe Techniques: Unlike coverage technique, it selects those test cases that cause a modified program to produce different output other than the original program.
The parameters which form the basis of comparison and evaluation of the selection techniques are as follows:
- Inclusiveness: Analyses the extent to which a test case selection will cause the modified program to produce different output other than the original. Helps to capture faults caused as a result of modifications.
- Precision Those test cases are not selected that won't produce a different output than the original one.
- Efficiency: Calculates the cost of computing and practicality of adopting a technique.
- Generality: Ability of a technique to handle varied language constructs, complex changes in the system.
Summary:
The above analysis about regression test selection brings out the core idea behind regression testing, the selection criteria involved and the ways to counter the issues involved. Regression testing can be thought of as a backbone to the entire process of "software maintenance". It is a technique for solving the issues left out while in the software development phase.
