Affiliation:
1. I‐BioStat, Data Science Institute Hasselt University Diepenbeek Belgium
2. Department of Applied Mathematics, Computer Science and Statistics Ghent University Gent Belgium
3. National Institute of Applied Statistics Research Australia (NIASRA) University of Wollongong Wollongong Australia
Abstract
AbstractThe two‐sample problem is one of the earliest problems in statistics: given two samples, the question is whether or not the observations were sampled from the same distribution. Many statistical tests have been developed for this problem, and many tests have been evaluated in simulation studies, but hardly any study has tried to set up a neutral comparison study. In this paper, we introduce an open science initiative that potentially allows for neutral comparisons of two‐sample tests. It is designed as an open‐source R package, a repository, and an online R Shiny app. This paper describes the principles, the design of the system and illustrates the use of the system.