Research on power allocation of integrated VLPC based on deep reinforcement learning

Shuai MA; Bing LI; Haihong SHENG; Rongyan GU; Hui ZHOU; Hongmei WANG; Yue WANG; Shiyin LI

doi:10.11959/j.issn.1000-436x.2022163

您当前的位置：

首页 >

文章列表页 >

Research on power allocation of integrated VLPC based on deep reinforcement learning

Papers | 更新时间：2024-06-05

- Research on power allocation of integrated VLPC based on deep reinforcement learning
- Journal on Communications Vol. 43, Issue 8, Pages: 121-130(2022)
- 作者机构：
- 作者简介：
- 基金信息：
- DOI：10.11959/j.issn.1000-436x.2022163
  CLC： TN92
- Online First：2022-08，
  
  Published：25 August 2022
- 稿件说明：
移动端阅览
Shuai MA, Bing LI, Haihong SHENG, et al. Research on power allocation of integrated VLPC based on deep reinforcement learning[J]. Journal on Communications, 2022, 43(8): 121-130.
DOI：

Shuai MA, Bing LI, Haihong SHENG, et al. Research on power allocation of integrated VLPC based on deep reinforcement learning[J]. Journal on Communications, 2022, 43(8): 121-130. DOI： 10.11959/j.issn.1000-436x.2022163.

摘要

为了实现定位通信一体化功率分配，提出了一种基于深度强化学习的可见光定位通信（VLPC）一体化系统的功率分配方案。首先，提出了定位通信一体化帧结构设计；其次，利用定位信息实现了信道状态信息的估计，并推导了定位误差的克拉美罗下界（CRLB）；再次，阐明了定位精度和通信速率的内在耦合关系；最后，提出了基于深度确定性策略梯度的VLPC动态功率分配方案。仿真结果表明，所提方案可同时实现高精度定位和高速通信。

Abstract

A power allocation scheme for integrated visible light position and communication (VLPC) system based on deep reinforcement learning was proposed to achieve power allocation for communication positioning integration.First

the frame structure design of integrated VLPC was proposed.Then the channel state information could be estimated by using the positioning information

and the CRLB of the positioning error was derived.Furthermore

the internal coupling relationship between positioning accuracy and communication rate was clarified.On this basis

a dynamic power allocation scheme based on deep deterministic policy gradient was proposed.Simulation results show that the proposed scheme can simultaneously achieve high-precision positioning and high-speed communication.

关键词

Keywords

references

LIU G Y , HUANG Y H , LI N , et al . Vision,requirements and network architecture of 6G mobile network beyond 2030 [J ] . China Communications , 2020 , 17 ( 9 ): 92 - 104 .

迟楠 , 陈慧 . 高速可见光通信的前沿研究进展 [J ] . 光电工程 , 2020 , 47 ( 3 ): 190687 .

CHI N , CHEN H . Progress and prospect of high-speed visible light communication [J ] . Opto-Electronic Engineering , 2020 , 47 ( 3 ): 190687 .

DAI L L , WANG B C , YUAN Y F , et al . Non-orthogonal multiple access for 5G:solutions,challenges,opportunities,and future research trends [J ] . IEEE Communications Magazine , 2015 , 53 ( 9 ): 74 - 81 .

JIANG W , HAN B , HABIBI M A , et al . The road towards 6G:a comprehensive survey [J ] . IEEE Open Journal of the Communications Society , 2021 , 2 : 334 - 366 .

MA S , LI H , HE Y , et al . Capacity bounds and interference management for interference channel in visible light communication networks [J ] . IEEE Transactions on Wireless Communications , 2019 , 18 ( 1 ): 182 - 193 .

JIANG R , WANG Q , HAAS H , et al . Joint user association and power allocation for cell-free visible light communication networks [J ] . IEEE Journal on Selected Areas in Communications , 2018 , 36 ( 1 ): 136 - 148 .

SHI J Y , ZHU X , WANG F M , et al . Net data rate of 14.6 Gbit/s underwater VLC utilizing silicon substrate common-anode five primary colors LED [C ] // Proceedings of Optical Fiber Communication Conference . Washington:OSA , 2019 : 1 - 3 .

YANG S H , JUNG E M , HAN S K . Indoor location estimation based on LED visible light communication using multiple optical receivers [J ] . IEEE Communications Letters , 2013 , 17 ( 9 ): 1834 - 1837 .

YANG S H , KIM H S , SON Y H , et al . Three-dimensional visible light indoor localization using AOA and RSS with multiple optical receivers [J ] . Journal of Lightwave Technology , 2014 , 32 ( 14 ): 2480 - 2485 .

WU Y C , HSU K L , LIU Y , et al . Using linear interpolation to reduce the training samples for regression based visible light positioning system [J ] . IEEE Photonics Journal , 2020 , 12 ( 2 ): 1 - 5 .

YANG H L , ZHONG W D , CHEN C , et al . QoS-driven optimized design-based integrated visible light communication and positioning for indoor IoT networks [J ] . IEEE Internet of Things Journal , 2020 , 7 ( 1 ): 269 - 283 .

LIN B J , TANG X , GHASSEMLOOY Z , et al . Experimental demonstration of an indoor VLC positioning system based on OFDMA [J ] . IEEE Photonics Journal , 2017 , 9 ( 2 ): 1 - 9 .

YANG H L , CHEN C , ZHONG W D , et al . Demonstration of a quasi-gapless integrated visible light communication and positioning system [J ] . IEEE Photonics Technology Letters , 2018 , 30 ( 23 ): 2001 - 2004 .

YANG H L , DU P F , ZHONG W D , et al . Reinforcement learning-based intelligent resource allocation for integrated VLCP systems [J ] . IEEE Wireless Communications Letters , 2019 , 8 ( 4 ): 1204 - 1207 .

WANG X M , ZHANG Y H , SHEN R J , et al . DRL-based energy-efficient resource allocation frameworks for uplink NOMA systems [J ] . IEEE Internet of Things Journal , 2020 , 7 ( 8 ): 7279 - 7294 .

CHU M , LI H , LIAO X W , et al . Reinforcement learning-based multiaccess control and battery prediction with energy harvesting in IoT systems [J ] . IEEE Internet of Things Journal , 2019 , 6 ( 2 ): 2009 - 2020 .

KAHN J M , BARRY J R . Wireless infrared communications [J ] . Proceedings of the IEEE , 1997 , 85 ( 2 ): 265 - 298 .

STEVENS N , STEENDAM H . Magnitude of the distance estimation bias in received signal strength visible light positioning [J ] . IEEE Communications Letters , 2018 , 22 ( 11 ): 2250 - 2253 .

KESKIN M F , SEZER A D , GEZICI S . Optimal and robust power allocation for visible light positioning systems under illumination constraints [J ] . IEEE Transactions on Communications , 2019 , 67 ( 1 ): 527 - 542 .

MA S , ZHANG F , LI H , et al . Simultaneous lightwave information and power transfer in visible light communication systems [J ] . IEEE Transactions on Wireless Communications , 2019 , 18 ( 12 ): 5818 - 5830 .

周志华 . 机器学习 [M ] . 北京 : 清华大学出版社 , 2016 .

ZHOU Z H . Machine learning [M ] . Beijing : Tsinghua University Press , 2016 .

MNIH V , KAVUKCUOGLU K , SILVER D , et al . Human-level control through deep reinforcement learning [J ] . Nature , 2015 , 518 ( 7540 ): 529 - 533 .

XU Y H , YANG C C , HUA M , et al . Deep deterministic policy gradient (DDPG)-based resource allocation scheme for NOMA vehicular communications [J ] . IEEE Access , 2020 , 8 : 18797 - 18807 .

CALABRESE F D , WANG L , GHADIMI E , et al . Learning radio resource management in RANs:framework,opportunities,and challenges [J ] . IEEE Communications Magazine , 2018 , 56 ( 9 ): 138 - 145 .

Views

1816

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

RL-WGAN based method for 5G network anomalous data generation

Study on Co-EDCA mechanism for multi-AP collaboration in FTTR C-WAN architecture

Design and implementation of an IPv6+ based intelligent computing-network scheduling scheme for Internet of vehicles

Survey of node localization scheme in underwater wireless sensor network

Adaptive defense model for critical assets against unknown network threats

Related Author

Ning Zhaolong

Zou Daoyuan

Zhou Li

Ouyang Ruiqi

Xiong Xuanrui

WU Weimin

ZENG Chen

YU Zhaoyang

Related Institution

School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications

College of Electronic Science and Technology, National University of Defense Technology

School of Electronic Information and Communication, Huazhong University of Science and Technology

Intelligent and Connected Vehicle Research Institute, China Unicom Smart Connection Technology Limited

School of Computer Science, Beijing University of Posts and Telecommunications

AI问答

⁰