Affiliation:
1. Haifa University Campus, Haifa, Israel
2. ORT Braude College of Engineering, Karmiel, Israel
Abstract
For several decades, computer scientists have been arguing which mean is more appropriate for summarizing computer performance: the harmonic or the geometric. We show that many test cases used in the past to discredit one mean or the other are either artificial or incidental. Changing only one of the benchmarks may result in totally different conclusions.In addition, we conclude that for the SPEC CPU2000 benchmark suite, the choice of averaging has very little influence on the relative standing of different machines. Therefore, the decision to purchase one system rather then another should not be influenced by the type of averaging used.
Publisher
Association for Computing Machinery (ACM)
Reference11 articles.
1. How not to lie with statistics: the correct way to summarize benchmark results
2. R. Grappel and J. Hemenway. A tale of four uPs: Benchmarks quantify performance. Electronic Design News (EDN) 26(7):179--265 April 1981. R. Grappel and J. Hemenway. A tale of four uPs: Benchmarks quantify performance. Electronic Design News (EDN) 26(7):179--265 April 1981.
3. Re-evaluation of the RISC I
Cited by
15 articles.
订阅此论文施引文献
订阅此论文施引文献，注册后可以免费订阅5篇论文的施引文献，订阅后可以查看论文全部施引文献