An Experimental Approach and Monitoring Tools for Evaluating a Dynamic Cubing System

Abstract

In this paper, the authors propose an approach and different tools to evaluate the performance and assess the effectiveness of a model in the field of dynamic cubing. Experimental evaluation, on one hand allows observing the behavior and the performance of the solution, while on the other hand it lets one compare the results with those of the other competing solutions. The authors' proposal includes an experimental workflow based on a set of configuration parameters to characterize the inputs (data sets, queries sets and algorithm input parameters) and a set of metrics to analyze and qualify the output (performance and behavior metrics) of the solution. They have identified a number of useful tools necessary to develop an experimental evaluation strategy. These monitoring tools allow elaborating the execution scenarios, collecting output metrics and storing and analyzing them online in real-time as well as later in off-line mode. Using a use-case model, the authors show that the framework and the proposed environment help carrying out a rigorous experimental evaluation of a dynamic cubing solution.