On the prevalence of uninformative parameters in statistical models applying model selection in applied ecology

Abstract

AbstractResearch in applied ecology provides scientific evidence to guide conservation policy and management. Applied ecology is becoming increasingly quantitative and model selection via information criteria has become a common statistical modeling approach. Unfortunately, parameters that contain little to no useful information are commonly presented and interpreted as important in applied ecology. I review the concept of an uninformative parameter in model selection using information criteria and perform a literature review to measure the prevalence of uninformative parameters in model selection studies applying Akaike’s Information Criterion (AIC) in 2014 in four of the top journals in applied ecology (Biological Conservation, Conservation Biology, Ecological Applications, Journal of Applied Ecology). Twenty-one percent of studies I reviewed applied AIC metrics. Many (31.5 %) of the studies applying AIC metrics in the four applied ecology journals I reviewed had or were very likely to have uninformative parameters in a model set. In addition, more than 40 % of studies reviewed had insufficient information to assess the presence or absence of uninformative parameters in a model set. Given the prevalence of studies likely to have uninformative parameters or with insufficient information to assess parameter status (71.5 %), I surmise that much of the policy recommendations based on applied ecology research may not be supported by the data analysis. I provide warning signals and a decision tree to help reduce the prevalence of uninformative parameters in studies applying model selection with information criteria. The four warning signals and decision tree should assist authors, reviewers, and editors to screen for uninformative parameters in studies applying model selection with information criteria. In the end, careful thinking at every step of the scientific process and greater reporting standards are required to detect uninformative parameters in studies adopting an information criteria approach.