Model Selection for High Dimensional Nonparametric Additive Models via Ridge Estimation
-
Published:2022-12-01
Issue:23
Volume:10
Page:4551
-
ISSN:2227-7390
-
Container-title:Mathematics
-
language:en
-
Short-container-title:Mathematics
Author:
Wang Haofeng,
Jin Hongxia,
Jiang XuejunORCID,
Li Jingzhi
Abstract
In ultrahigh dimensional data analysis, to keep computational performance well and good statistical properties still working, nonparametric additive models face increasing challenges. To overcome them, we introduce a methodology of model selection for high dimensional nonparametric additive models. Our approach is to propose a novel group screening procedure via nonparametric smoothing ridge estimation (GRIE) to find the importance of each covariate. It is then combined with the sure screening property of GRIE and the model selection property of extended Bayesian information criteria (EBIC) to select the suitable sub-models in nonparametric additive models. Theoretically, we establish the strong consistency of model selection for the proposed method. Extensive simulations and two real datasets illustrate the outstanding performance of the GRIE-EBIC method.
Funder
National Natural Science Foundation of China
the Shenzhen Sci-Tech Fund
the NSF of China
Guangdong NSF Major Fund
Subject
General Mathematics,Engineering (miscellaneous),Computer Science (miscellaneous)
Reference28 articles.
1. Regression shrinkage and selection via the lasso;Tibshirani;J. R. Stat. Soc. Ser. B Stat. Methodol.,1996
2. Variable selection via nonconcave penalized likelihood and its oracle properties;Fan;J. Am. Stat. Assoc.,2001
3. The Dantzig selector: Statistical estimation when p is much larger than n;Candes;Ann. Stat.,2007
4. Nearly unbiased variable selection under minimax concave penalty;Zhang;Ann. Stat.,2010
5. Ultrahigh dimensional feature selection: Beyond the linear model;Fan;J. Mach. Learn. Res.,2009