Performance model’s development: a novel approach encompassing ontology-based data access and visual analytics

Abstract

AbstractThe quantitative evaluation of research is currently carried out by means of indicators calculated on data extracted and integrated by analysts who elaborate them by creating illustrative tables and plots of results. In this approach, the robustness of the metrics used and the possibility for users of the metrics to intervene in the evaluation process are completely neglected. We propose a new approach which is able to move forward, from indicators’ development to an interactive performance model’s development. It combines the advantages of the ontology-based data access paradigm with the flexibility and robustness of a visual analytics environment putting the consumer/stakeholder at the centre of the evaluation. A detailed description of such an approach is presented in the paper. The approach is illustrated and evaluated trough a comprehensive user’s study that proves the added capabilities and the benefits that a user of performance models can have by using this approach.