Affiliation:
1. Department of Electronic Engineering, Tsinghua University, Beijing 100084, China
2. Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China
3. Department of Electrical and Computer Engineering, Hong Kong University of Science and Technology (HKUST), Hong Kong 999077
Abstract
In recent years, semantic communication has received significant attention from both academia and industry, driven by the growing demands for ultra-low latency and high-throughput capabilities in emerging intelligent services. Nonetheless, a comprehensive and effective theoretical framework for semantic communication has yet to be established. In particular, finding the fundamental limits of semantic communication, exploring the capabilities of semantic-aware networks, or utilizing theoretical guidance for deep learning in semantic communication are very important yet still unresolved issues. In general, the mathematical theory of semantic communication and the mathematical representation of semantics are referred to as semantic information theory. In this paper, we introduce the pertinent advancements in semantic information theory. Grounded in the foundational work of Claude Shannon, we present the latest developments in semantic entropy, semantic rate-distortion, and semantic channel capacity. Additionally, we analyze some open problems in semantic information measurement and semantic coding, providing a theoretical basis for the design of a semantic communication system. Furthermore, we carefully review several mathematical theories and tools and evaluate their applicability in the context of semantic communication. Finally, we shed light on the challenges encountered in both semantic communication and semantic information theory.
Funder
National Key Research and Development Program of China
Subject
General Physics and Astronomy
Reference99 articles.
1. The roadmap to 6G: AI empowered wireless networks;Letaief;IEEE Commun. Mag.,2019
2. Beyond transmitting bits: Context, semantics, and task-oriented communications;Qin;IEEE J. Sel. Areas Commun.,2022
3. Semantic communications for future internet: Fundamentals, applications, and challenges;Yang;IEEE Commun. Surv. Tutor.,2022
4. Shannon, C.E., and Weaver, W. (1949). The Mathematical Theory of Communication, The University of Illinois Press.
5. Qin, Z., Tao, X., Lu, J., Tong, W., and Li, G.Y. (2021). Semantic communications: Principles and challenges. arXiv.