Abstract
Evaluating the performance of self-adaptive systems is challenging due to their interactions with often highly dynamic environments. In the specific case of self-healing systems, the performance evaluations of self-healing approaches and their parameter tuning rely on the considered characteristics of failure occurrences and the resulting interactions with the self-healing actions. In this paper, we first study the state-of-the-art for evaluating the performances of self-healing systems by means of a systematic literature review. We provide a classification of different input types for such systems and analyse the limitations of each input type. A main finding is that the employed inputs are often not sophisticated regarding the considered characteristics for failure occurrences. To further study the impact of the identified limitations, we present experiments demonstrating that wrong assumptions regarding the characteristics of the failure occurrences can result in large performance prediction errors, disadvantageous design-time decisions concerning the selection of alternative self-healing approaches, and disadvantageous deployment-time decisions concerning parameter tuning. Furthermore, the experiments indicate that employing multiple alternative input characteristics can help with reducing the risk of premature disadvantageous design-time decisions.
Subject
Computer Networks and Communications,Human-Computer Interaction
Reference73 articles.
1. Challenges in Composing and Decomposing Assurances for Self-Adaptive Systems;Schmerl,2017
2. An evaluation method for Self-Adaptive systems
3. Chapter 13—An Overview on Quality Evaluation of Self-Adaptive Systems;Raibulet,2017
4. A survey on self-healing systems: approaches and systems
5. Quality Evaluation of Self-Adaptive Systems: Challenges and Opportunities;de Sousa,2019
Cited by
8 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. CHESS: A Framework for Evaluation of Self-Adaptive Systems Based on Chaos Engineering;2023 IEEE/ACM 18th Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS);2023-05
2. On Evaluating Self-Adaptive and Self-Healing Systems using Chaos Engineering;2022 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS);2022-09
3. Hybrid Planning with Receding Horizon: A Case for Meta-self-awareness;2021 IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C);2021-09
4. Self-Healing Dilemmas in Distributed Systems: Fault Correction vs. Fault Tolerance;IEEE Transactions on Network and Service Management;2021-09
5. Towards Resilient Method: An exhaustive survey of fault tolerance methods in the cloud computing environment;Computer Science Review;2021-05