Affiliation:
1. Institute of Computational Intelligence Cz˛estochowa University of Technology, Armii Krajowej 36˛ Czestochowa , Poland
Abstract
Abstract
Two types of heuristic estimators based on Parzen kernels are presented. They are able to estimate the regression function in an incremental manner. The estimators apply two techniques commonly used in concept-drifting data streams, i.e., the forgetting factor and the sliding window. The methods are applicable for models in which both the function and the noise variance change over time. Although nonparametric methods based on Parzen kernels were previously successfully applied in the literature to online regression function estimation, the problem of estimating the variance of noise was generally neglected. It is sometimes of profound interest to know the variance of the signal considered, e.g., in economics, but it can also be used for determining confidence intervals in the estimation of the regression function, as well as while evaluating the goodness of fit and in controlling the amount of smoothing. The present paper addresses this issue. Specifically, variance estimators are proposed which are able to deal with concept drifting data by applying a sliding window and a forgetting factor, respectively. A number of conducted numerical experiments proved that the proposed methods perform satisfactorily well in estimating both the regression function and the variance of the noise.
Subject
Applied Mathematics,Engineering (miscellaneous),Computer Science (miscellaneous)
Reference42 articles.
1. Alippi, C., Boracchi, G. and Roveri, M. (2017). Hierarchical change-detection tests, IEEE Transactions on Neural Networks and Learning Systems 28(2): 246-258.
2. Andrzejewski, W., Gramacki, A. and Gramacki, J. (2013). Graphics processing units in acceleration of bandwidth selection for kernel density estimation, International Journal of Applied Mathematics and Computer Science 23(4): 869-885, DOI: 10.2478/amcs-2013-0065.10.2478/amcs-2013-0065
3. Bifet, A., Holmes, G., Kirkby, R. and Pfahringer, B. (2010). MOA: Massive online analysis, Journal of Machine Learning Research 11: 1601-1604.
4. Brown, L.D. and Levine, M. (2007). Variance estimation in nonparametric regression via the difference sequence method, Annals of Statistics 35(5): 2219-2232.
5. Carroll, R.J. and Ruppert, D. (1988). Transformation and Weighting in Regression, CRC Press, Boca Raton, FL.
Cited by
11 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献