Affiliation:
1. Renmin University of China
2. Beijing HaiZhi XingTu Technology Co., Ltd
3. Tsinghua University
Abstract
Recent studies have shown the promise of directly processing compressed graphs. However, its benefits have been limited by high peak-memory usage and unbearably long compression time. In this paper, we introduce Laconic, a novel rule-based graph processing solution that overcomes the challenges of restricted memory and impractical compression time faced by existing approaches. Laconic, for the first time, ensures minimal memory overhead during compression and significantly reduces graph sizes, thus reducing peak memory demand during computations. By employing an efficient parallel compression algorithm, Laconic achieves a remarkable reduction in compression time. In our experiments, we compare Laconic with state-of-the-art solutions. The results demonstrate that Laconic outperforms other methods, reducing peak memory consumption by an average of 70% during compression and 66% during computation. Additionally, Laconic reduces rule compression time by an average of 93% compared to traditional rule-based compression, achieving a 2.47× higher compression ratio, and providing a 2.12× performance speedup.
Publisher
Association for Computing Machinery (ACM)
Reference118 articles.
1. Daniel Abadi, Samuel Madden, and Miguel Ferreira. 2006. Integrating compression and execution in column-oriented database systems. In Proceedings of the 2006 ACM SIGMOD international conference on Management of data. 671--682.
2. Rachit Agarwal, Anurag Khandelwal, and Ion Stoica. 2015. Succinct: Enabling queries on compressed data. In 12th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 15). 337--350.
3. Power graph compression reveals dominant relationships in genetic transcription networks;Ahnert Sebastian E;Molecular BioSystems,2013
4. Space and time savings through large data base compression and dynamic restructuring;Alsberg Peter A;Proc. IEEE,1975
5. Graph compression by BFS;Apostolico Alberto;Algorithms,2009