A data transformation process for using Benford’s Law with bounded data

Abstract

Benford’s Law is an empirical observation about the frequency of digits in a variety of naturally occurring data sets. Auditors and forensic scientists have used Benford’s Law to detect erroneous data in accounting and legal usage. One well-known limitation is that Benford’s Law fails when data have clear minimum and maximum values. Many kinds of education data, including assessment scores, typically include hard maximums and therefore do not meet the parametric assumptions of Benford’s Law. This paper implements a transformation procedure which allows for assessment data to be compared to Benford’s Law. As a case study, a data quality assessment of oral language scores from the Early Childhood Longitudinal Study, Kindergarten (ECLS-K) study is used and higher risk data segments detected. The same method could be used to evaluate other concerns, such as test fraud, or other bounded datasets.