Affiliation:
1. Federal University of Pernambuco, Recife, Brazil
2. ISTI - CNR, Pisa, Italy
Abstract
Coverage criteria provide a useful and widely used means to guide software testing; however, indiscriminately pursuing full coverage may not always be convenient or meaningful, as not all entities are of interest in any usage context. We aim at introducing a more meaningful notion of coverage that takes into account how the software is going to be used. Entities that are not going to be exercised by the user should not contribute to the coverage ratio. We revisit the definition of coverage measures, introducing a notion of relative coverage. According to this notion, we provide a definition and a theoretical framework of relative coverage, within which we discuss implications on testing theory and practice. Through the evaluation of three different instances of relative coverage, we could observe that relative coverage measures provide a more effective strategy than traditional ones: we could reach higher coverage measures, and test cases selected by relative coverage could achieve higher reliability. We hint at several other useful implications of relative coverage notion on different aspects of software testing.
Publisher
Association for Computing Machinery (ACM)
Cited by
6 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Cross-coverage testing of functionally equivalent programs;2023 IEEE/ACM International Conference on Automation of Software Test (AST);2023-05
2. Measuring and achieving test coverage of attack simulations extended version;Software and Systems Modeling;2022-09-17
3. Extending Data Flow Coverage to Test Constraint Refinements;Lecture Notes in Computer Science;2022
4. Priority-wise Test Case Allocation using Fuzzy Logic;International Journal of System Assurance Engineering and Management;2021-08-24
5. Encoding Test Cases using Execution Traces;2021 12th International Conference on Information and Communication Systems (ICICS);2021-05-24