Fast Real-Time Data Process Analysis Based on NoSQL for IoT Pavement Quality Management Platform

Abstract

The quality of road pavements is highly impacted by environmental variables, such as temperature, humidity, and weather; and construction-related variables, such as material quality and time. In this paper, an advanced data collection and analysis system based on big data/cloud was proposed for the use of IoT location-based smart platforms for pavement quality big data at road pavement sites. For the big data platform, a relational database management system (RDBMS) for a general alphanumeric data-based infrastructure for IoT-based systems was designed based on distributed/parallel processing to enable rapid and big data collection and analysis. The structure was established based on a NoSQL-based database to enable real-time high-speed collection and analysis, and the big data platform was developed as a data collection and visualization infrastructure. When the big data system was studied using data analysis methods, the proposed system demonstrated improvements in data collection performance and analysis speed, indicating that analysis results could be derived in real time. Specifically, the data collection processing (create) speed of the NoSQL-based system (0.405 ms) was significantly higher than that of the compared existing system (21.146 ms). Real-time processing capacity was also verified based on quality big data generated on actual road pavements, and the proposed system was proven suitable for the real-time monitoring (the data collection processing) of road pavement quality big data.