Affiliation:
1. Khoury College of Computer Sciences, Northeastern University, 410 West Georgia Street, Vancouver, BC V6B 1Z3, Canada
Abstract
In the field of data transmission and storage, serialization formats play a crucial role by converting complex data structures into a byte stream that can be easily stored, transmitted, and reconstructed. Despite the myriad available serialization formats, ranging from JSON to Protobuf, each has limitations, particularly in balancing schema flexibility, performance, and data copying overhead. This paper introduces Lite2, a novel data serialization format that addresses these challenges by combining schemaless flexibility with the efficiency of zero-copy operations for flat or key–value pair data types. Unlike traditional formats that often require a predefined schema and involve significant data copying during serialization and deserialization, Lite2 offers a dynamic schemaless approach that eliminates unnecessary data copying, optimizing system performance and efficiency. Built upon a contiguously stored B-tree structure, Lite2 enables efficient data lookup and modification without deserialization, thereby achieving zero-copy operations.
Reference40 articles.
1. Crockford, D., and Morningstar, C. (2017). Standard ECMA-404 The JSON Data Interchange Syntax, ECMA International.
2. Google (2008). Protocol Buffers: Google’s Data Interchange Format, Google. Technical report.
3. Proos, D.P., and Carlsson, N. (2020, January 22–25). Performance comparison of messaging protocols and serialization formats for digital twins in IoV. Proceedings of the 2020 IFIP Networking Conference (Networking), Virtual.
4. Popić, S., Pezer, D., Mrazovac, B., and Teslić, N. (2016, January 12–14). Performance evaluation of using Protocol Buffers in the Internet of Things communication. Proceedings of the 2016 International Conference on Smart Systems and Technologies (SST), Osijek, Croatia.
5. Tagdiwala, V., Bharoliya, A., Patel, P., Shah, D., and Aibin, M. (2023, January 24–27). Robust Client and Server State Synchronisation Framework For React Applications: React-state-sync. Proceedings of the 2023 IEEE Canadian Conference on Electrical and Computer Engineering (CCECE), Regina, SK, Canada.