COVID-19 outbreaks surveillance through text mining applied to electronic health records

Abstract

Abstract Background The COVID-19 pandemic has caused significant disruptions to everyday life and has had social, political, and financial consequences that will persist for years. Several initiatives with intensive use of technology were quickly developed in this scenario. However, technologies that enhance epidemiological surveillance in contexts with low testing capacity and healthcare resources are scarce. Therefore, this study aims to address this gap by developing a data science model that uses routinely generated healthcare encounter records to detect possible new outbreaks early in real-time. Methods We defined an epidemiological indicator that is a proxy for suspected cases of COVID-19 using the health records of Emergency Care Unit (ECU) patients and text mining techniques. The open-field dataset comprises 2,760,862 medical records from nine ECUs, where each record has information about the patient’s age, reported symptoms, and the time and date of admission. We also used a dataset where 1,026,804 cases of COVID-19 were officially confirmed. The records range from January 2020 to May 2022. Sample cross-correlation between two finite stochastic time series was used to evaluate the models. Results For patients with age ≥18 years, we find time-lag ($$\tau_c$$ τ c ) = 72 days and cross-correlation ($${\widehat p}_{ij}$$ p ^ ij ) ~0.82, $$\tau_c$$ τ c = 25 days and $${\widehat p}_{ij}$$ p ^ ij ~0.93, and $$\tau_c$$ τ c = 17 days and $${\widehat p}_{ij}$$ p ^ ij ~0.88 for the first, second, and third waves, respectively. Conclusions In conclusion, the developed model can aid in the early detection of signs of possible new COVID-19 outbreaks, weeks before traditional surveillance systems, thereby anticipating in initiating preventive and control actions in public health with a higher likelihood of success.