Affiliation:
1. Peking University, Beijing, China
2. University of Texas at Dallas, Beijing, China
3. University of Nebraska, Lincoln, NE
Abstract
Test case prioritization techniques attempt to reorder test cases in a manner that increases the rate at which faults are detected during regression testing. Coverage-based test case prioritization techniques typically use one of two overall strategies: a
total strategy
or an
additional strategy
. These strategies prioritize test cases based on the total number of code (or code-related) elements covered per test case and the number of additional (not yet covered) code (or code-related) elements covered per test case, respectively. In this article, we present a unified test case prioritization approach that encompasses both the total and additional strategies. Our unified test case prioritization approach includes two models (
basic
and
extended
) by which a spectrum of test case prioritization techniques ranging from a purely total to a purely additional technique can be defined by specifying the value of a parameter referred to as the
f
p
value. To evaluate our approach, we performed an empirical study on 28 Java objects and 40 C objects, considering the impact of three internal factors (model type, choice of
f
p
value, and coverage type) and three external factors (coverage granularity, test case granularity, and programming/testing paradigm), all of which can be manipulated by our approach. Our results demonstrate that a wide range of techniques derived from our basic and extended models with uniform
f
p
values can outperform purely total techniques and are competitive with purely additional techniques. Considering the influence of each internal and external factor studied, the results demonstrate that various values of each factor have nontrivial influence on test case prioritization techniques.
Funder
Division of Computer and Network Systems
National Natural Science Foundation of China
Air Force Office of Scientific Research
Ministry of Science and Technology of the People's Republic of China
Science Fund for Creative Research Groups
Publisher
Association for Computing Machinery (ACM)
Reference52 articles.
1. J. H. Andrews L. C. Briand and Y. Labiche. 2005. Is mutation an appropriate tool for testing experiments? In Proceedings of the International Conference on Software Engineering (ICSE'05). 402--411. 10.1145/1062455.1062530 J. H. Andrews L. C. Briand and Y. Labiche. 2005. Is mutation an appropriate tool for testing experiments? In Proceedings of the International Conference on Software Engineering (ICSE'05). 402--411. 10.1145/1062455.1062530
2. Using Mutation Analysis for Assessing and Comparing Testing Coverage Criteria
3. An empirical study of the effect of time constraints on the cost-benefits of regression testing
4. An empirical study of regression testing techniques incorporating context and lifetime factors and improved cost-benefit models
Cited by
72 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献