Affiliation:
1. The Irish Software Research Centre, LERO and CSIS, University of Limerick, LERO, Limerick, Ireland
2. The Irish Software Research Centre, LERO and CSIS, University of Limerick, Limerick, Ireland
Abstract
Feature location (FL) is the task of finding the source code that implements a specific, user-observable functionality in a software system. It plays a key role in many software maintenance tasks and a wide variety of Feature Location Techniques (FLTs), which rely on source code structure or textual analysis, have been proposed by researchers. As FLTs evolve and more novel FLTs are introduced, it is important to perform comparison studies to investigate “Which are the best FLTs?” However, an initial reading of the literature suggests that performing such comparisons would be an arduous process, based on the large number of techniques to be compared, the heterogeneous nature of the empirical designs, and the lack of transparency in the literature. This article presents a systematic review of 170 FLT articles, published between the years 2000 and 2015. Results of the systematic review indicate that 95% of the articles studied are directed towards novelty, in that they propose a novel FLT. Sixty-nine percent of these novel FLTs are evaluated through standard empirical methods but, of those, only 9% use baseline technique(s) in their evaluations to allow cross comparison with other techniques. The heterogeneity of empirical evaluation is also clearly apparent: altogether, over 60 different FLT evaluation metrics are used across the 170 articles, 272 subject systems have been used, and 235 different benchmarks employed. The review also identifies numerous user input formats as contributing to the heterogeneity. Analysis of the existing research also suggests that only 27% of the FLTs presented might be reproduced from the published material. These findings suggest that comparison across the existing body of FLT evaluations is very difficult. We conclude by providing guidelines for empirical evaluation of FLTs that may ultimately help to standardise empirical research in the field, cognisant of FLTs with different goals, leveraging common practices in existing empirical evaluations and allied with rationalisations. This is seen as a step towards standardising evaluation in the field, thus facilitating comparison across FLTs.
Funder
Science Foundation Ireland
Publisher
Association for Computing Machinery (ACM)
Cited by
25 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Feature Location Using Extraction of Code Documentation;Proceedings of the 8th International Conference on Sustainable Information Engineering and Technology;2023-10-24
2. Decomposition of Monolith Applications Into Microservices Architectures: A Systematic Review;IEEE Transactions on Software Engineering;2023-08
3. Spectrum-based feature localization for families of systems;Journal of Systems and Software;2023-01
4. Query Expansion Based On User Requirements Clustering for Finding Feature Location;2022 6th International Conference on Information Technology, Information Systems and Electrical Engineering (ICITISEE);2022-12-13
5. A COMPARISON STUDY : THE EFFECT OF NOUNS AND VERBS IN FINDING FEATURE LOCATION;7th International Conference on Sustainable Information Engineering and Technology 2022;2022-11-22