浏览全部资源
扫码关注微信
1. 华北电力大学新能源电力系统国家重点实验室,北京 102206
2. 东南大学移动通信国家重点实验室,江苏 南京 210096
3. 国网山东省电力公司电力科学研究院,山东 济南 250003
[ "周振宇(1983- ),男,河北张家口人,博士,华北电力大学教授、博士生导师,主要研究方向为无线通信网络与新技术、物联网与现代传感技术、能源互联网信息通信技术等。" ]
[ "贾泽晗(1998- ),男,河北保定人,华北电力大学硕士生,主要研究方向为电力物联网、智能电网中无线通信技术等。" ]
[ "廖海君(1997- ),女,广西贵港人,华北电力大学博士生,主要研究方向为电力物联网、智能电网中无线通信技术等。" ]
[ "赵雄文(1964- ),男,陕西延安人,博士,华北电力大学教授、博士生导师,主要研究方向为5G和后5G无线通信、电力系统通信等。" ]
[ "张磊(1989- ),男,河南新乡人,国网山东省电力公司高级工程师,主要研究方向为电力系统运行与控制等。" ]
网络出版日期:2021-03,
纸质出版日期:2021-03-25
移动端阅览
周振宇, 贾泽晗, 廖海君, 等. 基于上下文学习的电力物联网接入控制方法[J]. 通信学报, 2021,42(3):150-159.
Zhenyu ZHOU, Zehan JIA, Haijun LIAO, et al. Context-aware learning-based access control method for power IoT[J]. Journal on communications, 2021, 42(3): 150-159.
周振宇, 贾泽晗, 廖海君, 等. 基于上下文学习的电力物联网接入控制方法[J]. 通信学报, 2021,42(3):150-159. DOI: 10.11959/j.issn.1000-436x.2021062.
Zhenyu ZHOU, Zehan JIA, Haijun LIAO, et al. Context-aware learning-based access control method for power IoT[J]. Journal on communications, 2021, 42(3): 150-159. DOI: 10.11959/j.issn.1000-436x.2021062.
针对6G时代电力物联网海量终端接入冲突严重、队列积压大、能量效率低等问题,提出了一种基于上下文学习的接入控制算法。所提算法基于强化学习和快速上行链路授权技术,考虑终端活跃与休眠2种状态,优化目标为在终端接入服务质量需求的长期约束下最大化网络总能量效率。利用李雅普诺夫优化对长期优化目标与约束进行解耦,将长期优化问题转化为单时隙独立的确定性子问题,并利用基于终端状态感知的上置信界算法进行求解。仿真结果表明,所提算法能够在满足终端接入服务质量需求的同时,有效提高网络总能量效率。相较于传统快速上行链路授权算法,所提算法可提高平均能量效率 48.11%,提高满足接入服务质量需求的终端比例54.95%,降低平均队列积压83.83%。
In view of the problems of severe access conflicts
high queue backlog
and low energy efficiency in the massive terminal access scenario of the power Internet of things (power IoT) in 6G era
a context-aware learning-based access control (CLAC) algorithm was proposed.The proposed algorithm was based on reinforcement learning and fast uplink grant technology
considering active state and dormant state of terminals
and the optimization objective was to maximize the total network energy efficiency under the long-term constraint of terminal access service quality requirements.Lyapunov optimization was used to decouple the long-term optimization objective and constraint
and the long-term optimization problem was transformed into a series of single time-slot independent deterministic sub-problems
which could be solved by the terminal state-aware upper confidence bound algorithm.The simulation results show that CLAC can improve the network energy efficiency while meeting the terminal access service quality requirements.Compared with the traditional fast uplink grant
CLAC can improve the average energy efficiency by 48.11%
increase the proportion of terminals meeting access service quality requirements by 54.95%
and reduce the average queue backlog by 83.83%.
傅质馨 , 李潇逸 , 袁越 . 泛在电力物联网关键技术探讨 [J ] . 电力建设 , 2019 , 40 ( 5 ): 5 - 16 .
FU Z X , LI X Y , YUAN Y . Research on key technologies of ubiquitous power Internet of things [J ] . Electric Power Construction , 2019 , 40 ( 5 ): 5 - 16 .
方敏 , 段向阳 , 胡留军 . 6G技术挑战、创新与展望 [J ] . 中兴通讯技术 , 2020 , 26 ( 3 ): 61 - 70 .
FANG M , DUAN X Y , HU L J . Challenges,innovations and perspectives towards 6G [J ] . ZTE Technology Journal , 2020 , 26 ( 3 ): 61 - 70 .
王承祥 , 黄杰 , 王海明 , 等 . 面向6G的无线通信信道特性分析与建模 [J ] . 物联网学报 , 2020 , 4 ( 1 ): 19 - 32 .
WANG C X , HUANG J , WANG H M , et al . 6G oriented wireless communication channel characteristics analysis and modeling [J ] . Chinese Journal on Internet of Things , 2020 , 4 ( 1 ): 19 - 32 .
HE H L , REN P Y , DU Q H , et al . Estimation based adaptive ACB scheme for M2M communications [C ] // 2015 International Conference on Wireless Algorithms,Systems and Applications . Berlin:Springer , 2015 : 165 - 174 .
HARWAHYU R , WANG X , SARI R , et al . Analysis of group paging with pre-backoff [J ] . EURASIP Journal on Wireless Communications and Networking , 2015 , 1 ( 2 ): 34 - 42 .
DHILLON H S , HUANG H C , VISWANATHAN H , et al . On resource allocation for machine-to-machine (M2M) communications in cellular networks [C ] // 2012 IEEE Globecom Workshops . Piscataway:IEEE Press , 2012 : 1638 - 1643 .
BOCKELMANN C , PRATAS N , NIKOPOUR H , et al . Massive machine-type communications in 5G:physical and MAC-layer solutions [J ] . IEEE Communications Magazine , 2016 , 54 ( 9 ): 59 - 65 .
3GPP . Study on latency reduction techniques for LTE:3GPP TR 36.881 version 14.0.0 Release 14 [S ] . 2016 .
ALI S , RAJATHEVA N , SAAD W . Fast uplink grant for machine type communications:challenges and opportunities [J ] . IEEE Communications Magazine , 2019 , 57 ( 3 ): 97 - 103 .
KIM W , JI H , SHIM B . Fast uplink access in TDD systems for ultra reliable and low latency communications [C ] // 2018 IEEE Region 10 Conference . Piscataway:IEEE Press , 2018 : 1616 - 1619 .
严牧 , 孙耀 , 冯钢 . 基于强化学习的无线网络智能接入控制技术 [J ] . 中兴通讯技术 , 2018 , 24 ( 2 ): 10 - 14 , 46 .
YAN M , SUN Y , FENG G . The intelligent access control mechanisms in wireless network based on reinforcement learning [J ] . ZTE Technology Journal , 2018 , 24 ( 2 ): 10 - 14 , 46 .
HASAN M , HOSSAIN E , NIYATO D . Random access for machine-to-machine communication in LTE-advanced networks:issues and approaches [J ] . IEEE Communications Magazine , 2013 , 51 ( 6 ): 86 - 93 .
SUN H , NALLANATHAN A , WANG C , et al . Wideband spectrum sensing for cognitive radio networks:a survey [J ] . IEEE Wireless Communications , 2013 , 20 ( 2 ): 74 - 81 .
BARVE S S , KULKARNI P . Dynamic channel selection and routing through reinforcement learning in cognitive radio networks [C ] // IEEE International Conference on Computational Intelligence and Computing Research . Piscataway:IEEE Press , 2013 : 1 - 7 .
ALI S , FERDOWSI A , SAAD W , et al . Sleeping multi-armed bandit learning for fast uplink grant allocation in machine type communications [J ] . IEEE Transactions on Communications , 2020 , 68 ( 8 ): 5072 - 5086 .
周振宇 , 陈亚鹏 , 潘超 , 等 . 面向智能电力巡检的高可靠低时延移动边缘计算技术 [J ] . 高电压技术 , 2020 , 46 ( 6 ): 1895 - 1902 .
ZHOU Z Y , CHEN Y P , PAN C , et al . Ultra-reliable and low-latency mobile edge computing technology for intelligent power inspection [J ] . High Voltage Engineering , 2020 , 46 ( 6 ): 1895 - 1902 .
LIAO H , ZHOU Z , ZHAO X , et al . Learning-based context-aware resource allocation for edge computing-empowered industrial IoT [J ] . IEEE Internet of Things Journal , 2020 , 7 ( 5 ): 4260 - 4277 .
VERDU S . Spectral efficiency in the wideband regime [J ] . IEEE Transactions on Information Theory , 2002 , 48 ( 6 ): 1319 - 1343 .
NEELY M J . Energy optimal control for time-varying wireless networks [J ] . IEEE Transactions on Information Theory , 2006 , 52 ( 7 ): 2915 - 2934 .
ZHOU Z Y , GUO Y F , HE Y H , et al . Access control and resource allocation for M2M communications in industrial automation [J ] . IEEE Transactions on Industrial Informatics , 2019 , 15 ( 5 ): 3093 - 3103 .
TANG L , WEI Y N , CHEN W , et al . Delay-aware dynamic resource allocation and ABS configuration algorithm in HetNets based on Lyapunov optimization [J ] . IEEE Access , 2017 , 5 : 23764 - 23775 .
MODI N , MARY P , MOY C . QoS driven channel selection algorithm for cognitive radio network:multi-user multi-armed bandit approach [J ] . IEEE Transactions on Cognitive Communications and Networking , 2017 , 3 ( 1 ): 49 - 66 .
SUTTON R S , BARTO A G . Reinforcement learning:an introduction [M ] . Massachusetts : MIT Press , 1998 .
ALI S , SAAD W , RAJATHEVA N . A directed information learning framework for event-driven M2M traffic prediction [J ] . IEEE Communications Letters , 2018 , 22 ( 11 ): 2378 - 2381 .
0
浏览量
653
下载量
0
CSCD
关联资源
相关文章
相关作者
相关机构