基于深度强化学习的可见光定位通信一体化功率分配研究

马帅; 李兵; 盛海鸿; 谷荣妍; 周辉; 王洪梅; 王悦; 李世银

doi:10.11959/j.issn.1000-436x.2022163

您当前的位置：

首页 >

文章列表页 >

基于深度强化学习的可见光定位通信一体化功率分配研究

学术论文 | 更新时间：2024-06-05

- 基于深度强化学习的可见光定位通信一体化功率分配研究
- Research on power allocation of integrated VLPC based on deep reinforcement learning
- 通信学报 2022年43卷第8期页码：121-130
- 作者机构：
- 作者简介：
  
  [ "马帅（1986- ），男，山东日照人，博士，中国矿业大学副教授，主要研究方向为语义通信和可见光通信定位一体化等" ]
  [ "李兵（1997- ），男，河南商丘人，中国矿业大学硕士生，主要研究方向为可见光通信和可见光定位" ]
  [ "盛海鸿（1998- ），女，江苏泰州人，中国矿业大学硕士生，主要研究方向为无线通信和可见光通信" ]
  [ "谷荣妍（1999- ），女，安徽六安人，中国矿业大学硕士生，主要研究方向为可见光通信和可见光定位" ]
  [ "周辉（1997- ），男，湖北荆州人，中国矿业大学硕士生，主要研究方向为可见光通信和定位通信一体化" ]
  [ "王洪梅（1983- ），女，山东诸城人，博士，中国矿业大学副教授，主要研究方向为无线通信" ]
  [ "王悦（1994- ），女，吉林四平人，博士，中国矿业大学副教授，主要研究方向为光通信、微波光子学、集成光子器件等" ]
  [ "李世银（1971- ），男，四川犍为人，博士，中国矿业大学教授、博士生导师，主要研究方向为煤矿信息化和移动目标定位" ]
- 基金信息：
  
  中央高校基本科研业务费专项资金资助项目;The Fundamental Research Funds for the Central Universities(2022QN1052);江苏省自然科学基金资助项目;The Natural Science Foundation of Jiangsu Province(BK20221115);中国矿业大学未来科学家计划基金资助项目;Funded by the Graduate Innovation Program of China University of Mining and Technology(2022WLJCRCZL108)
- DOI：10.11959/j.issn.1000-436x.2022163
  中图分类号： TN92
- 网络出版日期：2022-08，
  
  纸质出版日期：2022-08-25
- 稿件说明：
移动端阅览
马帅, 李兵, 盛海鸿, 等. 基于深度强化学习的可见光定位通信一体化功率分配研究[J]. 通信学报, 2022,43(8):121-130.

Shuai MA, Bing LI, Haihong SHENG, et al. Research on power allocation of integrated VLPC based on deep reinforcement learning[J]. Journal on communications, 2022, 43(8): 121-130.
马帅, 李兵, 盛海鸿, 等. 基于深度强化学习的可见光定位通信一体化功率分配研究[J]. 通信学报, 2022,43(8):121-130. DOI： 10.11959/j.issn.1000-436x.2022163.

Shuai MA, Bing LI, Haihong SHENG, et al. Research on power allocation of integrated VLPC based on deep reinforcement learning[J]. Journal on communications, 2022, 43(8): 121-130. DOI： 10.11959/j.issn.1000-436x.2022163.

摘要

为了实现定位通信一体化功率分配，提出了一种基于深度强化学习的可见光定位通信（VLPC）一体化系统的功率分配方案。首先，提出了定位通信一体化帧结构设计；其次，利用定位信息实现了信道状态信息的估计，并推导了定位误差的克拉美罗下界（CRLB）；再次，阐明了定位精度和通信速率的内在耦合关系；最后，提出了基于深度确定性策略梯度的VLPC动态功率分配方案。仿真结果表明，所提方案可同时实现高精度定位和高速通信。

Abstract

A power allocation scheme for integrated visible light position and communication (VLPC) system based on deep reinforcement learning was proposed to achieve power allocation for communication positioning integration.First

the frame structure design of integrated VLPC was proposed.Then the channel state information could be estimated by using the positioning information

and the CRLB of the positioning error was derived.Furthermore

the internal coupling relationship between positioning accuracy and communication rate was clarified.On this basis

a dynamic power allocation scheme based on deep deterministic policy gradient was proposed.Simulation results show that the proposed scheme can simultaneously achieve high-precision positioning and high-speed communication.

关键词

Keywords

references

LIU G Y , HUANG Y H , LI N , et al . Vision,requirements and network architecture of 6G mobile network beyond 2030 [J ] . China Communications , 2020 , 17 ( 9 ): 92 - 104 .

迟楠 , 陈慧 . 高速可见光通信的前沿研究进展 [J ] . 光电工程 , 2020 , 47 ( 3 ): 190687 .

CHI N , CHEN H . Progress and prospect of high-speed visible light communication [J ] . Opto-Electronic Engineering , 2020 , 47 ( 3 ): 190687 .

DAI L L , WANG B C , YUAN Y F , et al . Non-orthogonal multiple access for 5G:solutions,challenges,opportunities,and future research trends [J ] . IEEE Communications Magazine , 2015 , 53 ( 9 ): 74 - 81 .

JIANG W , HAN B , HABIBI M A , et al . The road towards 6G:a comprehensive survey [J ] . IEEE Open Journal of the Communications Society , 2021 , 2 : 334 - 366 .

MA S , LI H , HE Y , et al . Capacity bounds and interference management for interference channel in visible light communication networks [J ] . IEEE Transactions on Wireless Communications , 2019 , 18 ( 1 ): 182 - 193 .

JIANG R , WANG Q , HAAS H , et al . Joint user association and power allocation for cell-free visible light communication networks [J ] . IEEE Journal on Selected Areas in Communications , 2018 , 36 ( 1 ): 136 - 148 .

SHI J Y , ZHU X , WANG F M , et al . Net data rate of 14.6 Gbit/s underwater VLC utilizing silicon substrate common-anode five primary colors LED [C ] // Proceedings of Optical Fiber Communication Conference . Washington:OSA , 2019 : 1 - 3 .

YANG S H , JUNG E M , HAN S K . Indoor location estimation based on LED visible light communication using multiple optical receivers [J ] . IEEE Communications Letters , 2013 , 17 ( 9 ): 1834 - 1837 .

YANG S H , KIM H S , SON Y H , et al . Three-dimensional visible light indoor localization using AOA and RSS with multiple optical receivers [J ] . Journal of Lightwave Technology , 2014 , 32 ( 14 ): 2480 - 2485 .

WU Y C , HSU K L , LIU Y , et al . Using linear interpolation to reduce the training samples for regression based visible light positioning system [J ] . IEEE Photonics Journal , 2020 , 12 ( 2 ): 1 - 5 .

YANG H L , ZHONG W D , CHEN C , et al . QoS-driven optimized design-based integrated visible light communication and positioning for indoor IoT networks [J ] . IEEE Internet of Things Journal , 2020 , 7 ( 1 ): 269 - 283 .

LIN B J , TANG X , GHASSEMLOOY Z , et al . Experimental demonstration of an indoor VLC positioning system based on OFDMA [J ] . IEEE Photonics Journal , 2017 , 9 ( 2 ): 1 - 9 .

YANG H L , CHEN C , ZHONG W D , et al . Demonstration of a quasi-gapless integrated visible light communication and positioning system [J ] . IEEE Photonics Technology Letters , 2018 , 30 ( 23 ): 2001 - 2004 .

YANG H L , DU P F , ZHONG W D , et al . Reinforcement learning-based intelligent resource allocation for integrated VLCP systems [J ] . IEEE Wireless Communications Letters , 2019 , 8 ( 4 ): 1204 - 1207 .

WANG X M , ZHANG Y H , SHEN R J , et al . DRL-based energy-efficient resource allocation frameworks for uplink NOMA systems [J ] . IEEE Internet of Things Journal , 2020 , 7 ( 8 ): 7279 - 7294 .

CHU M , LI H , LIAO X W , et al . Reinforcement learning-based multiaccess control and battery prediction with energy harvesting in IoT systems [J ] . IEEE Internet of Things Journal , 2019 , 6 ( 2 ): 2009 - 2020 .

KAHN J M , BARRY J R . Wireless infrared communications [J ] . Proceedings of the IEEE , 1997 , 85 ( 2 ): 265 - 298 .

STEVENS N , STEENDAM H . Magnitude of the distance estimation bias in received signal strength visible light positioning [J ] . IEEE Communications Letters , 2018 , 22 ( 11 ): 2250 - 2253 .

KESKIN M F , SEZER A D , GEZICI S . Optimal and robust power allocation for visible light positioning systems under illumination constraints [J ] . IEEE Transactions on Communications , 2019 , 67 ( 1 ): 527 - 542 .

MA S , ZHANG F , LI H , et al . Simultaneous lightwave information and power transfer in visible light communication systems [J ] . IEEE Transactions on Wireless Communications , 2019 , 18 ( 12 ): 5818 - 5830 .

周志华 . 机器学习 [M ] . 北京 : 清华大学出版社 , 2016 .

ZHOU Z H . Machine learning [M ] . Beijing : Tsinghua University Press , 2016 .

MNIH V , KAVUKCUOGLU K , SILVER D , et al . Human-level control through deep reinforcement learning [J ] . Nature , 2015 , 518 ( 7540 ): 529 - 533 .

XU Y H , YANG C C , HUA M , et al . Deep deterministic policy gradient (DDPG)-based resource allocation scheme for NOMA vehicular communications [J ] . IEEE Access , 2020 , 8 : 18797 - 18807 .

CALABRESE F D , WANG L , GHADIMI E , et al . Learning radio resource management in RANs:framework,opportunities,and challenges [J ] . IEEE Communications Magazine , 2018 , 56 ( 9 ): 138 - 145 .

浏览量

750

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于软提示微调和强化学习的网络安全命名实体识别方法研究

基于FL的无蜂窝网络用户调度与功率分配策略

基于功率分离接收机方案的低复杂度信号检测算法

无人机辅助MEC系统中基于最优SIC顺序的能耗优化方案

基于审计博弈的安全协作频谱感知方案