Early Detection and Reconstruction of Abnormal Data Using Hybrid VAE-LSTM Framework
Author:
Hou Fangli1ORCID, Ma Jun2ORCID, Cheng Jack C. P.3ORCID, Kwok Helen H.L.1ORCID
Affiliation:
1. The Hong Kong University of Science and Technology, HK 2. The University of Hong Kong, HK 3. University of Hong KongThe Hong Kong University of Science and Technology, HK
Abstract
Early failure detection and abnormal data reconstruction in sensor data provided by building ventilation control systems are critical for public health. Early detection of abnormal data can help prevent failures in crucial components of ventilation systems, which can result in a variety of issues, from energy wastage to catastrophic outcomes. However, conventional fault detection models ignore valuable features of dynamic fluctuations in indoor air quality (IAQ) measurements and early warning signals of faulty sensor data. This study introduces a hybrid framework for early failure detection and abnormal data reconstruction applying variance analysis and variational autoencoders (VAE) coupled with the long short-term memory network (VAE-LSTM). The periodicity and stable fluctuation of IAQ data are exploited by variance analysis to detect unusual variations before failure occurs. The IAQ dataset which is corrupted by introducing complete failure, bias failure and precision degradation fault is then used to verify the feasibility of the VAE-LSTM model. The results of variance analysis reveal that unusual behavior of the data can be detected as early as 12 hours before failure occurs. The reconstruction performance of the developed method is shown to be superior to other methods under different abnormal data scenarios
Publisher
Firenze University Press
Reference28 articles.
1. Ali, A., & Dağtekin, R. (2008). Early warning signals of the 2000/2001 Turkish financial crisis. International Journal of Emerging and Transition Economies, 1(2), 191-218. 2. Breunig, M. M., Kriegel, H.-P., Ng, R. T., & Sander, J. (2000). LOF: identifying density-based local outliers. Paper presented at the Proceedings of the 2000 ACM SIGMOD international conference on Management of data. 3. Bu, J., Liu, Y., Zhang, S., Meng, W., Liu, Q., Zhu, X., & Pei, D. (2018). Rapid deployment of anomaly detection models for large number of emerging kpi streams. Paper presented at the 2018 IEEE 37th International Performance Computing and Communications Conference (IPCCC). 4. Cao, V. L., Nicolau, M., & McDermott, J. (2016). One-class classification for anomaly detection with kernel density estimation and genetic programming. Paper presented at the Genetic Programming: 19th European Conference, EuroGP 2016, Porto, Portugal, March 30-April 1, 2016, Proceedings 19. 5. Drake, J. M., & Griffen, B. D. (2010). Early warning signals of extinction in deteriorating environments. Nature, 467(7314), 456-459.
|
|