Detecting Elevated Air Pollution Levels by Monitoring Web Search Queries (Preprint)

Author:

Lin ChenORCID,Yousefi Safoora,Kahoro Elvis,Karisani Payam,Liang Donghai,Sarnat Jeremy,Agichtein Eugene

Abstract

BACKGROUND

Real-time air pollution monitoring is a valuable tool for public health and environmental surveillance. In recent years, there has been a dramatic increase in air pollution forecasting and monitoring research using artificial neural networks (ANNs). Most of the prior work relied on modeling pollutant concentrations collected from ground-based monitors and meteorological data for long-term forecasting of outdoor ozone, oxides of nitrogen, and PM2.5. Given that traditional, highly sophisticated air quality monitors are expensive and are not universally available, these models cannot adequately serve those not living near pollutant monitoring sites. Furthermore, because prior models were built on physical measurement data collected from sensors, they may not be suitable for predicting public health effects experienced from pollution exposure.

OBJECTIVE

This study aims to develop and validate models to “nowcast” the observed pollution levels using Web search data, which is publicly available in near real-time from major search engines.

METHODS

We developed novel machine learning-based models using both traditional supervised classification methods and state-of-the-art deep learning methods to detect elevated air pollution levels at the US city level, by using generally available meteorological data and aggregate Web-based search volume data derived from Google Trends. We validated the performance of these methods by predicting three critical air pollutants (ozone (O3), nitrogen dioxide (NO2), and fine particulate matter (PM2.5)), across ten major U.S. metropolitan statistical areas (MSAs) in 2017 and 2018. We also explore different variations of the long-short term memory (LSTM) model and propose a novel search term Dictionary Learner-Long-Short Term Memory (DL-LSTM) model to learn sequential patterns across multiple search terms for prediction.

RESULTS

The top-performing model was a deep neural sequence model LSTM, using meteorological and Web search data, and reached an accuracy of 0.82 (F1 score: 0.51) for O3, 0.74 (F1 score:0.41) for NO2, and 0.85 (F1 score: 0.27) for PM2.5, when used for detecting elevated pollution levels. Compared with only using meteorological data, the proposed method achieved superior accuracy by incorporating Web search data.

CONCLUSIONS

The results show that incorporating Web search data with meteorological data improves nowcasting performance for all three pollutants and suggest promising novel applications for tracking global physical phenomena using Web search data

CLINICALTRIAL

Not Applicable

Publisher

JMIR Publications Inc.

同舟云学术

1.学者识别学者识别

2.学术分析学术分析

3.人才评估人才评估

"同舟云学术"是以全球学者为主线,采集、加工和组织学术论文而形成的新型学术文献查询和分析系统,可以对全球学者进行文献检索和人才价值评估。用户可以通过关注某些学科领域的顶尖人物而持续追踪该领域的学科进展和研究前沿。经过近期的数据扩容,当前同舟云学术共收录了国内外主流学术期刊6万余种,收集的期刊论文及会议论文总量共计约1.5亿篇,并以每天添加12000余篇中外论文的速度递增。我们也可以为用户提供个性化、定制化的学者数据。欢迎来电咨询!咨询电话:010-8811{复制后删除}0370

www.globalauthorid.com

TOP

Copyright © 2019-2024 北京同舟云网络信息技术有限公司
京公网安备11010802033243号  京ICP备18003416号-3