The probability distribution as a performance criterion when comparing alternative systems

Abstract

The Kolmogorov-Smirnov test is used to determine whether the output distributions of two simulated systems are significantly different. The advantages of using this statistical procedure, and the danger in making comparisons between the systems with only the mean as a critical performance measure, are dem onstrated. Two queuing systems were simulated and results analyzed first by comparing means and, then, distributions. Results showed that, even if the means of two alternative systems are equivalent, the systems may still prove to be significantly different from each other if the entire distribution is examined.