Robust change point detection for high‐dimensional linear models with tolerance for outliers and heavy tails

Author:

Yang Zhi1,Zhang Liwen1,Sun Siyu2,Liu Bin3ORCID

Affiliation:

1. School of Statistics and Management Shanghai University of Finance and Economics Shanghai China

2. Department of Statistics Shanghai University of Finance and Economics Zhejiang College Jinhua China

3. School of Management Fudan University Shanghai China

Abstract

AbstractThis article focuses on detecting change points in high‐dimensional linear regression models with piecewise constant regression coefficients, moving beyond the conventional reliance on strict Gaussian or sub‐Gaussian noise assumptions. In the face of real‐world complexities, where noise often deviates into uncertain or heavy‐tailed distributions, we propose two tailored algorithms: a dynamic programming algorithm (DPA) for improved localization accuracy, and a binary segmentation algorithm (BSA) optimized for computational efficiency. These solutions are designed to be flexible, catering to increasing sample sizes and data dimensions, and offer a robust estimation of change points without requiring specific moments of the noise distribution. The efficacy of DPA and BSA is thoroughly evaluated through extensive simulation studies and application to real datasets, showing their competitive edge in adaptability and performance.

Funder

National Natural Science Foundation of China

National Office for Philosophy and Social Sciences

Publisher

Wiley

Reference42 articles.

1. Estimating and testing linear models with multiple structural changes;Bai J.;Econometrica,1998

2. Impact of the 2015 El Niño event on winter air quality in China;Chang L.;Scientific Reports,2016

3. Chen S.(2019).Beijing multi‐site air quality. UCI Machine Learning Repository. doi:10.24432/C5RK5G.

4. Multiple change point detection for high dimensional time series via sparsified binary segmentation;Cho H.;Journal of the Royal Statistical Society: Series B (Statistical Methodology),2015

5. Complexity penalized M‐estimation: Fast computation;Friedrich F.;Journal of Computational and Graphical Statistics,2008

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3