Abstract
Data from emerging applications, such as cybersecurity and social networking, can be abstracted as graphs whose edges are updated sequentially in the form of a stream. The challenging problem of interactive graph stream analytics is the quick response of the queries on terabyte and beyond graph stream data from end users. In this paper, a succinct and efficient double index data structure is designed to build the sketch of a graph stream to meet general queries. A single pass stream model, which includes general sketch building, distributed sketch based analysis algorithms and regression based approximation solution generation, is developed, and a typical graph algorithm—triangle counting—is implemented to evaluate the proposed method. Experimental results on power law and normal distribution graph streams show that our method can generate accurate results (mean relative error less than 4%) with a high performance. All our methods and code have been implemented in an open source framework, Arkouda, and are available from our GitHub repository, Bader-Research. This work provides the large and rapidly growing Python community with a powerful way to handle terabyte and beyond graph stream data using their laptops.
Funder
National Science Foundation
Subject
Computational Mathematics,Computational Theory and Mathematics,Numerical Analysis,Theoretical Computer Science
Cited by
7 articles.
订阅此论文施引文献
订阅此论文施引文献,注册后可以免费订阅5篇论文的施引文献,订阅后可以查看论文全部施引文献
1. Focusing and Calibration of Large Scale Network Sensors Using GraphBLAS Anonymized Hypersparse Matrices;2023 IEEE High Performance Extreme Computing Conference (HPEC);2023-09-25
2. Deployment of Real-Time Network Traffic Analysis Using GraphBLAS Hypersparse Matrices and D4M Associative Arrays;2023 IEEE High Performance Extreme Computing Conference (HPEC);2023-09-25
3. Property Graphs in Arachne;2023 IEEE High Performance Extreme Computing Conference (HPEC);2023-09-25
4. High-Performance Truss Analytics in Arkouda;2022 IEEE 29th International Conference on High Performance Computing, Data, and Analytics (HiPC);2022-12
5. GraphBLAS on the Edge: Anonymized High Performance Streaming of Network Traffic;2022 IEEE High Performance Extreme Computing Conference (HPEC);2022-09-19