Affiliation:
1. Westfälische Wilhelms-Universität Münster Fachbereich 10 Mathematik und Informatik, Muenster, Germany
Abstract
Simulating and predicting the performance of a distributed software system that works under stringent real-time constraints poses significant challenges, particularly when dealing with legacy systems being in production use, where any disruption is intolerable. This challenge is exacerbated in the context of a System Under Evaluation (SUE) that operates within a resource-sharing environment, running concurrently with numerous other software components. In this paper, we introduce an innovative toolset designed for predicting the performance of such complex and time-critical software systems. Our toolset builds upon the RAST (
R
egression
A
nalysis,
S
imulation, and load
T
esting) approach, significantly enhanced in this paper compared to its initial version. While current state-of-the-art methods for performance prediction often rely on data collected by Application Performance Monitoring (APM), the unavailability of APM tools for existing systems and the complexities associated with integrating them into legacy software necessitate alternative approaches. Our toolset, therefore, utilizes readily accessible system request logs as a substitute for APM data. We describe the enhancements made to the original RAST approach, we outline the design and implementation of our RAST-based toolset, and we showcase its simulation accuracy and effectiveness using the publicly available TeaStore benchmarking system. To ensure the reproducibility of our experiments, we provide open access to our toolset’s implementation and the utilized TeaStore model.
Publisher
Association for Computing Machinery (ACM)
Reference40 articles.
1. Learning and statistical model checking of system response times; al K. Aichernig;Software Quality Journal,2019
2. Enhancing Cloud Computing Analysis: A CCE-Based HTTP-GET Log Dataset
3. David Beazley. 2010. Understanding the Python GIL. In PyCON Python Conference.
4. Grid search in hyperparameter optimization of machine learning models for prediction of HIV/AIDS test results
5. Jason Brownlee. 2020. How to Remove Outliers for Machine Learning. (2020). https://machinelearningmastery.com/how-to-use-statistics-to-identify-outliers-in-data/