Affiliation:
1. Department of Mathematics, Gonzaga University, Spokane, WA 99258-0102, USA
2. Department of Mathematics and Statistics, University of Windsor, Windsor, ON N9B 3P4, Canada
Abstract
The problem of model selection in regression analysis through the use of forward selection, backward elimination, and stepwise selection has been well explored in the literature. The main assumption in this, of course, is that the data are normally distributed and the main tool used here is either a t test or an F test. However, the properties of these model selection procedures are not well-known. The purpose of this paper is to study the properties of these procedures within generalized linear regression models, considering the normal linear regression model as a special case. The main tool that is being used is the score test. However, the F test and other large sample tests, such as the likelihood ratio and the Wald test, the AIC, and the BIC, are included for the comparison. A systematic study, through simulations, of the properties of this procedure was conducted, in terms of level and power, for symmetric and asymmetric distributions, such as normal, Poisson, and binomial regression models. Extensions for skewed distributions, over-dispersed Poisson (the negative binomial), and over-dispersed binomial (the beta-binomial) regression models, are also given and evaluated. The methods are applied to analyze two health datasets.
Funder
Natural Science and Engineering Research Council of Canada
University of Windsor
Subject
Physics and Astronomy (miscellaneous),General Mathematics,Chemistry (miscellaneous),Computer Science (miscellaneous)
Reference45 articles.
1. Methods and Criteria for Model Selection;Kadane;J. Am. Stat. Assoc.,2004
2. Note on Procedures for Variable Selection in Multiple Regression;Beale;Technometrics,1970
3. Kutner, M.H., Nachtsheim, C.J., Neter, J., and Li, W. (2013). Applied Linear Statistical Models, McGraw-Hill. [5th ed.].
4. A New Look at the Statistical Model Identification;Akaike;IEEE Trans. Autom. Control,1974
5. Estimating the Dimension of a Model;Schwarz;Ann. Stat.,1978
Cited by
1 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献