A Method for Identifying Gross Errors in Dam Monitoring Data

Abstract

Real and effective monitoring data are crucial in assessing the structural safety of dams. Gross errors, resulting from manual mismeasurement, instrument failure, or other factors, can significantly impact the evaluation process. It is imperative to eliminate such anomalous data. However, existing methods for detecting gross errors in concrete dam deformation often focus on analyzing a single monitoring effect quantity. This can lead to sudden jumps in values of effect quantity caused by changes in environmental variables being mistakenly identified as gross error. Therefore, a method based on Fuzzy C-Means clustering algorithm (FCM) partitioning and density clustering algorithm (Ordering Points To Identify the Clustering Structure, OPTICS) combined with Local Outlier Factor (LOF) algorithm for gross error identification is proposed. Firstly, the FCM algorithm is used to achieve the division of measurement point areas. Then, the OPTICS and LOF algorithms are jointly utilized to determine the gross errors. Finally, the real gross errors are identified by comparing the time of occurrence of the gross errors at measurement points in the same area. Through the case study, the results indicate that the method can effectively identify spurious, gross errors in the monitoring effect quantity caused by environmental mutations. The accuracy of gross error detection is significantly improved, and the rate of misjudgment of gross errors is reduced.