Affiliation:
1. University of Florida, Gainesville, FL, USA
2. University of Florida & Google Inc., Gainesville, FL, USA
Abstract
Persistent spread measurement is to count the number of distinct elements that persist in each network flow for predefined time periods. It has many practical applications, including detecting long-term stealthy network activities in the background of normal-user activities, such as stealthy DDoS attack, stealthy network scan, or faked network trend, which cannot be detected by traditional flow cardinality measurement. With big network data, one challenge is to measure the persistent spreads of a massive number of flows without incurring too much memory overhead as such measurement may be performed at the line speed by network processors with fast but small on-chip memory. We propose a highly compact Virtual Intersection HyperLogLog (VI-HLL) architecture for this purpose. It achieves far better memory efficiency than the best prior work of V-Bitmap, and in the meantime drastically extends the measurement range. Theoretical analysis and extensive experiments demonstrate that VI-HLL provides good measurement accuracy even in very tight memory space of less than 1 bit per flow.
Funder
National Science Foundation
Florida Center for Cybersecurity
Publisher
Association for Computing Machinery (ACM)
Subject
Computer Networks and Communications,Hardware and Architecture,Software
Reference25 articles.
1. C. Smith "By the Numbers: 100 Amazing Google Statistics and Facts " February 2016. {Online}. Available: http://expandedramblings.com/index.php/by-the-numbers-a-gigantic-list-of-google-stats-and-facts/10/ C. Smith "By the Numbers: 100 Amazing Google Statistics and Facts " February 2016. {Online}. Available: http://expandedramblings.com/index.php/by-the-numbers-a-gigantic-list-of-google-stats-and-facts/10/
2. "Twitter Usage Statistics." {Online}. Available: http://www.internetlivestats.com/twitter-statistics/ "Twitter Usage Statistics." {Online}. Available: http://www.internetlivestats.com/twitter-statistics/
3. New directions in traffic measurement and accounting
4. Data streaming algorithms for accurate and efficient measurement of traffic and flow matrices
5. Bitmap Algorithms for Counting Active Flows on High-Speed Links;Chen A.;Proc. of VLDB,2007
Cited by
3 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献