Abstract
AbstractContext-aware systems adapt their services to the user’s intentions and environment to improve the user experience. However, how to evaluate the quality of these systems in terms of user perception and context recognition is still an open problem. Our goal in this work is to evaluate the Quality-in-Use (QinU) for context-aware software systems according to the ISO/IEC 25010 standard and in an automated manner. This evaluation is oriented to be model-based, with domain specification and log data as input, while quality metrics and representations of users’ behavior as output. In this process, we use probabilistic models to discover user patterns, heuristic metrics as QinU estimation, clustering techniques to obtain user profiles according to their QinU, and feature selection to identify relevant factors of context. We propose a framework for assessing the QinU in context-aware software systems called Framework for Assessing Quality-in-use of Software (FAQuiS). FAQuiS includes a set of models to represent all dimensions of context, a methodology to apply the quality analysis to any system, and a set of tools and metrics to support and automate the process. We seek to test the impact and ease of integration in the industry for this framework. A case study in a company allows us to validate the applicability in a real environment. We analyze the mechanisms that support the QinU evaluation in context-aware systems, the feasibility of the QinU quantification, and the suitability of the integration in companies. Compared to previous works, our proposal offers a novel data-driven approach with general-purpose and industrial viability. FAQuiS can be used as a solution to assess the QinU based on the ISO 25010 standard and the models of user behaviors in different contexts. This solution analyzes the context changes in the user interaction, can quantify the quality loss in these contexts, and does not require big efforts to be integrated into a software development process.
Publisher
Springer Science and Business Media LLC
Reference57 articles.
1. Abowd GD, Dey AK, Brown PJ, Davies N, Smith M, Steggles P (1999) Towards a better understanding of context and context-awareness. In: Proceedings of the 1st international symposium on handheld and ubiquitous computing, Springer-Verlag, Berlin, Heidelberg, HUC ’99, pp 304–307
2. Al-Nanih R, Al-Nuaim H, Ormandjieva O (2009) New health information systems (HIS) quality-in-use model based on the GQM approach and HCI principles. In: Jacko JA (ed) Human-computer interaction. Interacting in various application domains. Springer, Berlin, pp 429–438. https://doi.org/10.1007/978-3-642-02583-9_47
3. Alnanih R, Ormandjieva O, Radhakrishnan T (2013) A new quality-in-use model for mobile user interfaces. In: 2013 Joint Conference of the 23rd International Workshop on Software Measurement and the 8th International Conference on Software Process and Product Measurement, pp 165–170
4. Alshareet O, Itradat A, Doush IA, Quttoum A (2018) Incorporation of ISO 25010 with machine learning to develop a novel quality in use prediction system (QiUPS). Int J Syst Assur Eng Manag 9(2):344–353. https://doi.org/10.1007/s13198-017-0649-x, http://link.springer.com/10.1007/s13198-017-0649-x
5. Arthur D, Vassilvitskii S (2007) K-means++: The advantages of careful seeding. In: Proceedings of the Eighteenth Annual ACM-SIAM Symposium on Discrete Algorithms, Society for Industrial and Applied Mathematics, Philadelphia, PA, USA, SODA ’07, pp 1027–1035
Cited by
4 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献