Affiliation:
1. University of Brescia - CNIT, Brescia, Italy
2. NEC Laboratories Europe, Heidelberg, Germany
Abstract
Recent work in network measurements focuses on scaling the performance of monitoring platforms to 10Gb/s and beyond. Concurrently, IT community focuses on scaling the analysis of big-data over a cluster of nodes. So far, combinations of these approaches have targeted flexibility and usability over real-timeliness of results and efficient allocation of resources. In this paper we show how to meet both objectives with BlockMon, a network monitoring platform originally designed to work on a single node, which we extended to run distributed stream-data analytics tasks. We compare its performance against Storm and Apache S4, the state-of-the-art open-source stream-processing platforms, by implementing a phone call anomaly detection system and a Twitter trending algorithm: our enhanced BlockMon has a gain in performance of over 2.5x and 23x, respectively. Given the different nature of those applications and the performance of BlockMon as single-node network monitor [1], we expect our results to hold for a broad range of applications, making distributed BlockMon a good candidate for the convergence of network-measurement and IT-analysis platforms.
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Software
Reference25 articles.
1. On Multi–gigabit Packet Capturing with Multi–core Commodity Hardware
2. MapReduce
3. Apache Hadoop. http://hadoop.apache.org (accessed 2012--11--10). Apache Hadoop. http://hadoop.apache.org (accessed 2012--11--10).
Cited by
11 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Net2Vec;Proceedings of the Workshop on Big Data Analytics and Machine Learning for Data Communication Networks;2017-08-07
2. FbMapping: AN AUTOMATED SYSTEM FOR MONITORING FACEBOOK DATA;Neural Network World;2017
3. A Four-Layer Architecture for Online and Historical Big Data Analytics;2016 IEEE 14th Intl Conf on Dependable, Autonomic and Secure Computing, 14th Intl Conf on Pervasive Intelligence and Computing, 2nd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech);2016-08
4. A domain-independent methodology to analyze IoT data streams in real-time. A proof of concept implementation for anomaly detection from environmental data;International Journal of Digital Earth;2016-07-29
5. Facing Network Management Challenges with Functional Data Analysis: Techniques & Opportunities;Mobile Networks and Applications;2016-05-04