A Modular Framework for Data Processing at the Edge: Design and Implementation
Author:
Urblik Lubomir1ORCID, Kajati Erik1ORCID, Papcun Peter1ORCID, Zolotova Iveta1ORCID
Affiliation:
1. Department of Cybernetics and Artificial Intelligence, Faculty of EE & Informatics, Technical University of Kosice, 042 00 Kosice, Slovakia
Abstract
There is a rapid increase in the number of edge devices in IoT solutions, generating vast amounts of data that need to be processed and analyzed efficiently. Traditional cloud-based architectures can face latency, bandwidth, and privacy challenges when dealing with this data flood. There is currently no unified approach to the creation of edge computing solutions. This work addresses this problem by exploring containerization for data processing solutions at the network’s edge. The current approach involves creating a specialized application compatible with the device used. Another approach involves using containerization for deployment and monitoring. The heterogeneity of edge environments would greatly benefit from a universal modular platform. Our proposed edge computing-based framework implements a streaming extract, transform, and load pipeline for data processing and analysis using ZeroMQ as the communication backbone and containerization for scalable deployment. Results demonstrate the effectiveness of the proposed framework, making it suitable for time-sensitive IoT applications.
Funder
APVV grant ENISaC—Edge-eNabled Intelligent Sensing and Computing
Subject
Electrical and Electronic Engineering,Biochemistry,Instrumentation,Atomic and Molecular Physics, and Optics,Analytical Chemistry
Reference48 articles.
1. Future edge cloud and edge computing for internet of things applications;Pan;IEEE Internet Things J.,2018 2. Krishnamurthi, R., Kumar, A., Gopinathan, D., Nayyar, A., and Qureshi, B. (2020). An Overview of IoT Sensor Data Processing, Fusion, and Analysis Techniques. Sensors, 20. 3. Sulieman, N.A., Ricciardi Celsi, L., Li, W., Zomaya, A., and Villari, M. (2022). Edge-Oriented Computing: A Survey on Research and Use Cases. Energies, 15. 4. Vaño, R., Lacalle, I., Sowiński, P., S-Julián, R., and Palau, C.E. (2023). Cloud-Native Workload Orchestration at the Edge: A Deployment Review and Future Directions. Sensors, 23. 5. Emerging trends, techniques and open issues of containerization: A Review;Watada;IEEE Access,2019
|
|