面向未来的语义通信：基本原理与实现方法

张平; 牛凯; 姚圣时; 戴金晟

doi:10.11959/j.issn.1000-436x.2023079

您当前的位置：

首页 >

文章列表页 >

面向未来的语义通信：基本原理与实现方法

专题：多/跨模态语义通信 | 更新时间：2024-06-06

- 面向未来的语义通信：基本原理与实现方法
- Semantic communications for future: basic principle and implementation methodology
- 通信学报 2023年44卷第5期页码：1-14
- 作者机构：
  
  1. 北京邮电大学网络与交换技术国家重点实验室，北京 100876
  2. 北京邮电大学泛网无线通信教育部重点实验室，北京 100876
- 作者简介：
  
  [ "张平（1959- ），男，陕西汉中人，博士，中国工程院院士，北京邮电大学教授、博士生导师，主要研究方向为先进移动通信系统等" ]
  [ "牛凯（1976- ），男，山西文水人，博士，北京邮电大学教授、博士生导师，主要研究方向为信息论与信道编码" ]
  [ "姚圣时（1997- ），男，江苏常熟人，北京邮电大学博士生，主要研究方向为信息论、信源信道编码和语义通信" ]
  [ "戴金晟（1992- ），男，湖南常德人，博士，北京邮电大学副教授、博士生导师，主要研究方向为无线通信信号处理、信息论与信道编码" ]
- 基金信息：
  
  国家自然科学基金资助项目(62293481);国家自然科学基金资助项目(92067202);国家自然科学基金资助项目(62071058)
- DOI：10.11959/j.issn.1000-436x.2023079
  中图分类号： TN911.22
- 网络出版日期：2023-05，
  
  纸质出版日期：2023-05-25
- 稿件说明：
移动端阅览
张平, 牛凯, 姚圣时, 等. 面向未来的语义通信：基本原理与实现方法[J]. 通信学报, 2023,44(5):1-14.

Ping ZHANG, Kai NIU, Shengshi YAO, et al. Semantic communications for future: basic principle and implementation methodology[J]. Journal on communications, 2023, 44(5): 1-14.
张平, 牛凯, 姚圣时, 等. 面向未来的语义通信：基本原理与实现方法[J]. 通信学报, 2023,44(5):1-14. DOI： 10.11959/j.issn.1000-436x.2023079.

Ping ZHANG, Kai NIU, Shengshi YAO, et al. Semantic communications for future: basic principle and implementation methodology[J]. Journal on communications, 2023, 44(5): 1-14. DOI： 10.11959/j.issn.1000-436x.2023079.

摘要

阐述了语义通信的基本原理与实现方法。首先，提出了语义通信的系统模型，梳理语义通信的基本概念与术语，对比经典通信与语义通信的主要区别，总结了语义通信的技术优势。在此基础上，回顾了语义信息论的发展，构建了语义信息的度量指标体系，提出了基于归一化条件复杂度的新型度量，用于评估语义压缩的极限，探讨了语义典型序列编码的性质，揭示语义编码的渐近性能。进一步地，归纳了语义编码传输的2种典型方法——直接编码与变换编码，分析了它们的基本原理，并针对文本、语音与图像信源展示了语义编码传输的优越性能。最后，总结了语义通信的研究难点与问题，指出未来的研究方向。

Abstract

The basic principle of semantic communications and the associated implementation methodology were introduced.First

the systematic model of semantic communications was proposed and basic concepts and terminology were deduced by comparing the fundamental differences between classic communications and semantic communications.Thus

the technological advantages of semantic communications were concluded.Then

the development of semantic information theory was retrospected and the measurement system of semantic information was established.Furthermore

the normalized conditional complexity (NCC) was proposed to evaluate the limit of semantic compression and the property of semantic typical sequence coding was discussed so as to reveal the corresponding asymptotic performance.In addition

the semantic coding transmission methods were classified into two typical schemes

that is

direct coding and transform coding

and the basic principles of these schemes were presented.For the text

speech

and image sources

the superior performance of the semantic coding techniques were demonstrated.Finally

the difficulty and open issues of the semantic communications were further concluded and further research directions were pointed out.

关键词

Keywords

references

SHANNON C E . A mathematical theory of communication [J ] . Bell System Technical Journal , 1948 , 27 ( 4 ): 623 - 656 .

MORRIS C W . Foundations of the theory of signs [M ] . Chicago : The University of Chicago Press , 1938 .

SHANNON C E , WEAVER W . The mathematical theory of communication [M ] . Urbana : The University of Illinois Press , 1971 .

BRILLOUIN L . Science and information theory [M ] . New York : Academic Press , 1956 .

CARNAP R , BAR-HILLEL Y . An outline of a theory of semantic information [R ] . 1952 .

BAR-HILLEL Y , CARNAP R . Semantic information [J ] . The British Journal for the Philosophy of Science , 1953 , 4 ( 14 ): 147 - 157 .

BARWISE J , PERRY J . Situations and attitudes [J ] . The Journal of Philosophy , 1981 , 78 ( 11 ): 668 - 691 .

FLORIDI L . Outline of a theory of strongly semantic information [J ] . Minds and Machines , 2004 , 14 ( 2 ): 197 - 221 .

KOLCHINSKY A , WOLPERT D H . Semantic information,autonomous agency and non-equilibrium statistical physics [J ] . Interface Focus , 2018 , 8 ( 6 ): 20180041 .

KOUNTOURIS M , PAPPAS N . Semantics-empowered communication for networked intelligent systems [J ] . IEEE Communications Magazine , 2021 , 59 ( 6 ): 96 - 102 .

RENYI A , . On measures of entropy and information [C ] // Proceedings of the Fourth Berkeley Symposium on Mathematical Statistics and Probability .[S.l.:s.n. ] , 1960 : 547 - 561 .

ZHANG P , XU W , GAO H , et al . Toward wisdom-evolutionary and primitive-concise 6G:a new paradigm of semantic communication networks [J ] . Engineering , 2022 , 8 ( 1 ): 60 - 73 .

ZHANG P , XU X , DONG C , et al . Intellicise communication system:model-driven semantic communications [J ] . The Journal of China Universities of Posts and Telecommunications , 2022 , 29 ( 1 ): 2 - 12 .

NIU K , DAI J C , YAO S S , et al . A paradigm shift toward semantic communications [J ] . IEEE Communications Magazine , 2022 , 60 ( 11 ): 113 - 119 .

牛凯 , 戴金晟 , 张平 , 等 . 面向6G的语义通信 [J ] . 移动通信 , 2021 , 45 ( 4 ): 85 - 90 .

NIU K , DAI J C , ZHANG P , et al . 6G-oriented semantic communications [J ] . Mobile Communications , 2021 , 45 ( 4 ): 85 - 90 .

SHI G M , XIAO Y , LI Y Y , et al . From semantic communication to semantic-aware networking:model,architecture,and open problems [J ] . IEEE Communications Magazine , 2021 , 59 ( 8 ): 44 - 50 .

石光明 , 李莹玉 , 谢雪梅 . 语义通讯:智能时代的产物 [J ] . 模式识别与人工智能 , 2018 , 31 ( 1 ): 91 - 99 .

SHI G M , LI Y Y , XIE X M . Semantic communications:outcome of the intelligence era [J ] . Pattern Recognition and Artificial Intelligence , 2018 , 31 ( 1 ): 91 - 99 .

石光明 , 肖泳 , 李莹玉 , 等 . 面向万物智联的语义通信网络 [J ] . 物联网学报 , 2021 , 5 ( 2 ): 26 - 36 .

SHI G M , XIAO Y , LI Y Y , et al . Semantic communication networking for the intelligence of everything [J ] . Chinese Journal on Internet of Things , 2021 , 5 ( 2 ): 26 - 36 .

QIN Z J , TAO X M , LU J H , et al . Semantic communications:principles and challenges [J ] . arXiv Preprint,arXiv:2201.01389 , 2022 .

XIE H Q , QIN Z J , TAO X M , et al . Task-oriented multi-user semantic communications [J ] . IEEE Journal on Selected Areas in Communications , 2022 , 40 ( 9 ): 2584 - 2597 .

SHI G M , GAO D H , SONG X D , et al . A new communication paradigm:from bit accuracy to semantic fidelity [J ] . arXiv Preprint,arXiv:2101.12649 , 2021 .

GÜNDÜZ D , QIN Z J , ESTELLA A I , et al . Guest editorial special issue on beyond transmitting bits:context,semantics,and task-oriented communications [J ] . IEEE Journal on Selected Areas in Communications , 2023 , 41 ( 1 ): 1 - 4 .

CHACCOUR C , SAAD W , DEBBAH M , et al . Less data,more knowledge:building next generation semantic communication networks [J ] . arXiv Preprint,arXiv:2211.14343 , 2022 .

LUO X W , CHEN H H , GUO Q . Semantic communications:overview,open issues,and future research directions [J ] . IEEE Wireless Communications , 2022 , 29 ( 1 ): 210 - 219 .

ZHUANG Z W , LI R , JIA K , et al . Perception-aware multi-sensor fusion for 3D LiDAR semantic segmentation [C ] // Proceedings of IEEE/CVF International Conference on Computer Vision . Piscataway:IEEE Press , 2022 : 16260 - 16270 .

MOHD T K , NGUYEN N , JAVAID A Y . Multi-modal data fusion in enhancing human-machine interaction for robotic applications:a survey [J ] . arXiv Preprint,arXiv:2202.07732 . 2022 .

LIU F , CUI Y H , MASOUROS C , et al . Integrated sensing and communications:toward dual-functional wireless networks for 6G and beyond [J ] . IEEE Journal on Selected Areas in Communications , 2022 , 40 ( 6 ): 1728 - 1767 .

ZHOU F H , LI Y H , ZHANG X Y , et al . Cognitive semantic communication systems driven by knowledge graph [C ] // Proceedings of IEEE International Conference on Communications . Piscataway:IEEE Press , 2022 : 4860 - 4865 .

ZHOU K , ZHAO W X , BIAN S Q , et al . Improving conversational recommender systems via knowledge graph based semantic fusion [C ] // Proceedings of the 26th ACM SIGKDD International Conference on Knowledge Discovery ＆ Data Mining . New York:ACM Press , 2020 : 1006 - 1014 .

LIU P F , YUAN W Z , FU J L , et al . Pre-train,prompt,and predict:a systematic survey of prompting methods in natural language processing [J ] . ACM Computing Surveys , 2023 , 55 ( 9 ): 1 - 35 .

LI W B , LIN Z , ZHOU K , et al . MAT:mask-aware transformer for large hole image inpainting [C ] // Proceedings of 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2022 : 10748 - 10758 .

ZHANG R , ISOLA P , EFROS A A , et al . The unreasonable effectiveness of deep features as a perceptual metric [C ] // Proceedings of 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition . Piscataway:IEEE Press , 2018 : 586 - 595 .

RIX A W , BEERENDS J G , HOLLIER M P , et al . Perceptual evaluation of speech quality (PESQ)-a new method for speech quality assessment of telephone networks and codecs [C ] // Proceedings of 2001 IEEE International Conference on Acoustics,Speech,and Signal Processing . Piscataway:IEEE Press , 2002 : 749 - 752 .

BAO J , BASU P , DEAN M K , et al . Towards a theory of semantic communication [C ] // Proceedings of 2011 IEEE Network Science Workshop . Piscataway:IEEE Press , 2011 : 110 - 117 .

LUCA A D , TERMINI S . A definition of a nonprobabilistic entropy in the setting of fuzzy sets theory [J ] . Information and Control , 1972 , 20 ( 4 ): 301 - 312 .

LUCA A D , TERMINI S . Entropy of L-fuzzy sets [J ] . Information and Control , 1974 , 24 ( 1 ): 55 - 73 .

KÖRNER J , . Coding of an information source having ambiguous alphabet and the entropy of graphs [C ] // Proceeding of the 6th Prague Conference on Information Theory .[S.l.:s.n. ] , 1973 : 411 - 425 .

KORNER J , MARTON K . Random access communication and graph entropy [J ] . IEEE Transactions on Information Theory , 1988 , 34 ( 2 ): 312 - 314 .

ALON N , ORLITSKY A . Source coding and graph entropies [J ] . IEEE Transactions on Information Theory , 1996 , 42 ( 5 ): 1329 - 1339 .

吴伟陵 . 广义信源与广义熵 [J ] . 北京邮电大学学报 , 1982 , 5 ( 1 ): 29 - 41 .

WU W L . Generalized information source and generalized entropy [J ] . Journal of Beijing University of Posts and Telecommunications , 1982 , 5 ( 1 ): 29 - 41 .

钟义信 . 信息科学原理 [M ] . 北京 : 北京邮电大学出版社 , 1996 .

ZHONG Y X . Theory of information science [M ] . Beijing : Beijing University of Posts and Telecommunications Press , 1996 .

钟义信 . 自然语言理解的全信息方法论 [J ] . 北京邮电大学学报 , 2004 , 27 ( 4 ): 1 - 12 .

ZHONG Y X . Comprehensive information based methodology for natural language understanding [J ] . Journal of Beijing University of Posts and Telecommunications , 2004 , 27 ( 4 ): 1 - 12 .

钟义信 . 信息生态学与语义信息论 [J ] . 图书情报知识 , 2017 ( 6 ): 4 - 11 .

ZHONG Y X . Information ecology and semantic information theory [J ] . Document,Information ＆ Knowledge , 2017 ( 6 ): 4 - 11 .

鲁晨光 . 广义熵和广义互信息的编码意义 [J ] . 通信学报 , 1994 , 15 ( 6 ): 37 - 44 .

LU C G . Meanings of generalized entropy and generalized mutual information for coding [J ] . Journal of China Institute of Communications , 1994 , 15 ( 6 ): 37 - 44 .

FAN P Y , DONG Y Q , LU J X , et al . Message importance measure and its application to minority subset detection in big data [C ] // Proceedings of 2016 IEEE GLOBECOM Workshops . Piscataway:IEEE Press , 2017 : 1 - 5 .

SHE R , LIU S Y , FAN P Y . Recognizing information feature variation:message importance transfer measure and its applications in big data [J ] . Entropy , 2018 , 20 ( 6 ): 401 .

LI M , VITÁNYI P , . An introduction to Kolmogorov complexity and its applications [M ] . New York : Springer , 2008 .

BOURTSOULATZE E , BURTH K D , GÜNDÜZ D , . Deep joint source-channel coding for wireless image transmission [J ] . IEEE Transactions on Cognitive Communications and Networking , 2019 , 5 ( 3 ): 567 - 579 .

TUNG T Y , KURKA D B , JANKOWSKI M , et al . DeepJSCC-Q:channel input constrained deep joint source-channel coding [C ] // Proceedings of IEEE International Conference on Communications . Piscataway:IEEE Press , 2022 : 3880 - 3885 .

XIE H Q , QIN Z J , LI G Y , et al . Deep learning enabled semantic communication systems [J ] . IEEE Transactions on Signal Processing , 2021 , 69 : 2663 - 2675 .

WENG Z Z , QIN Z J . Semantic communication systems for speech transmission [J ] . IEEE Journal on Selected Areas in Communications , 2021 , 39 ( 8 ): 2434 - 2444 .

XIE H Q , QIN Z J . A lite distributed semantic communication system for Internet of things [J ] . IEEE Journal on Selected Areas in Communications , 2021 , 39 ( 1 ): 142 - 153 .

BALLÉ J , CHOU P A , MINNEN D , et al . Nonlinear transform coding [J ] . IEEE Journal of Selected Topics in Signal Processing , 2020 , 15 ( 2 ): 339 - 353 .

BALLÉ J , LAPARRA V , SIMONCELLI E P . End-to-end optimized image compression [J ] . arXiv Preprint,arXiv:1611.01704v3 , 2016 .

YAO S S , XIAO Z X , DAI J C , et al . Variational speech waveform compression to catalyze semantic communications [C ] // Proceedings of IEEE Wireless Communications and Networking Conference . Piscataway:IEEE Press , 2023 : 1 - 6 .

DAI J C , ZHANG P , NIU K , et al . Communication beyond transmitting bits:semantics-guided source and channel coding [J ] . IEEE Wireless Communications , 2022 :doi.org/10.1109/mwc.017.2100705.

DAI J C , WANG S X , TAN K L , et al . Nonlinear transform source-channel coding for semantic communications [J ] . IEEE Journal on Selected Areas in Communications , 2022 , 40 ( 8 ): 2300 - 2316 .

WANG S X , DAI J C , LIANG Z J , et al . Wireless deep video semantic transmission [J ] . IEEE Journal on Selected Areas in Communications , 2022 , 41 ( 1 ): 214 - 229 .

WANG J , WANG S X , DAI J C , et al . Perceptual learned source-channel coding for high-fidelity image semantic transmission [C ] // Proceedings of 2022 Global Communications Conference . Piscataway:IEEE Press , 2022 : 3959 - 3964 .

XIAO Z X , YAO S S , DAI J C , et al . Wireless deep speech semantic transmission [C ] // Proceedings of 2023 International Conference on Acoustics,Speech and Signal Processing . Piscataway:IEEE Press , 2023 : 1 - 5 .

YAO S X , WANG S X , DAI J C , et al . Semantic information processing in industrial networks [J ] . The Journal of China Universities of Posts and Telecommunications , 2022 , 29 ( 1 ): 41 - 49 .

VASWANI A , SHAZEER N , PARMAR N , et al . Attention is all you need [C ] // Proceedings of the 31st International Conference on Neural Information Processing Systems . New York:ACM Press , 2017 : 6000 - 6010 .

WANG S X , DAI J C , YAO S S , et al . A novel deep learning architecture for wireless image transmission [C ] // Proceedings of 2021 IEEE Global Communications Conference . Piscataway:IEEE Press , 2022 : 1 - 6 .

YAO S S , NIU K , WANG S X , et al . Semantic coding for text transmission:an iterative design [J ] . IEEE Transactions on Cognitive Communications and Networking , 2022 , 8 ( 4 ): 1594 - 1603 .

LIU Z , LIN Y T , CAO Y , et al . Swin transformer:hierarchical vision transformer using shifted windows [C ] // Proceedings of IEEE/CVF International Conference on Computer Vision . Piscataway:IEEE Press , 2022 : 9992 - 10002 .

LIU L F , OESTGES C , POUTANEN J , et al . The COST2100 MIMO channel model [J ] . IEEE Wireless Communications , 2012 , 19 ( 6 ): 92 - 99 .

BESSETTE B , SALAMI R , LEFEBVRE R , et al . The adaptive multirate wideband speech codec (AMR-WB) [J ] . IEEE Transactions on Speech and Audio Processing , 2002 , 10 ( 8 ): 620 - 636 .

VALIN J , VOS K , TERRIBERRY T B . Definition of the opus audio codec [J ] . RFC , 2012 , 6716 : 1 - 326 .

SCHOEFFLER M , STÖTER F R , EDLER B . Towards the next generation of web-based experiments:a case study assessing basic audio quality following the ITU-R recommendation BS.1534 (MUSHRA) [C ] // Proceedings of the 1st Web Audio Conference .[S.l.:s.n. ] , 2015 : 1 - 6 .

浏览量

1241

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

面向语义通信的非线性变换编码