基于强化学习的服务链映射算法

魏亮; 黄韬; 张娇; 王泽南; 刘江; 刘韵洁

doi:10.11959/j.issn.1000-436x.2018002

您当前的位置：

首页 >

文章列表页 >

基于强化学习的服务链映射算法

学术论文 | 更新时间：2024-06-05

- 基于强化学习的服务链映射算法
- Service chain mapping algorithm based on reinforcement learning
- 通信学报 2018年39卷第1期页码：90-100
- 作者机构：
  
  北京邮电大学网络与交换技术国家重点实验室，北京 100876
- 作者简介：
  
  [ "魏亮（1981-），男，江苏扬州人，北京邮电大学博士生，主要研究方向为未来网络、软件定义网络、网络功能虚拟化等。" ]
  [ "黄韬（1980-），男，重庆人，博士，北京邮电大学教授，主要研究方向为路由与交换、软件定义网络、内容分发网络等。" ]
  [ "张娇（1986-），女，河北保定人，北京邮电大学副教授，主要研究方向为数据中心网络、网络功能虚拟化、软件定义网络、未来网络体系架构等。" ]
  [ "王泽南（1994-），男，浙江湖州人，北京邮电大学博士生，主要研究方向为网络功能虚拟化、网络智能等。" ]
  [ "刘江（1983-），男，河南郑州人，博士，北京邮电大学副教授，主要研究方向为网络体系架构、网络虚拟化、软件定义网络、信息中心网络等。" ]
  [ "刘韵洁（1943-），男，山东烟台人，中国工程院院士，北京邮电大学教授，主要研究方向为未来网络技术、网络体系架构、网络融合与演进等。" ]
- 基金信息：
  
  国家高技术研究发展计划基金资助项目（“863”计划）(2015AA016101);国家自然科学基金资助项目(61501042);北京市科技新星计划基金资助项目(Z151100000315078)
- DOI：10.11959/j.issn.1000-436x.2018002
  中图分类号： TP302
- 网络首发：2018-01，
  
  纸质出版：2018-01-25
- 稿件说明：
移动端阅览
魏亮, 黄韬, 张娇, 等. 基于强化学习的服务链映射算法[J]. 通信学报, 2018,39(1):90-100.

Liang WEI, Tao HUANG, Jiao ZHANG, et al. Service chain mapping algorithm based on reinforcement learning[J]. Journal on Communications, 2018, 39(1): 90-100.
魏亮, 黄韬, 张娇, 等. 基于强化学习的服务链映射算法[J]. 通信学报, 2018,39(1):90-100. DOI： 10.11959/j.issn.1000-436x.2018002.

Liang WEI, Tao HUANG, Jiao ZHANG, et al. Service chain mapping algorithm based on reinforcement learning[J]. Journal on Communications, 2018, 39(1): 90-100. DOI： 10.11959/j.issn.1000-436x.2018002.

摘要

提出基于人工智能技术的多智能体服务链资源调度架构，设计一种基于强化学习的服务链映射算法。通过Q-learning的机制，根据系统状态、执行部署动作后的奖惩反馈来决定服务链中各虚拟网元的部署位置。实验结果表明，与经典算法相比，该算法有效降低了业务的平均传输延时，提升了系统的负载均衡情况。

Abstract

A service chain resource scheduling architecture of multi-agent based on artificial intelligence technology was proposed.Meanwhile

a service chain mapping algorithm based on reinforcement learning was designed.Through the Q-learning mechanism

the location of each virtual network element in the service chain was determined according to the system status and the reward and punishment feedback after the deployment.The experimental results show that compared with the classical algorithms

the algorithm effectively reduces the average transmission delay of the service and improves the load balance of the system.

关键词

Keywords

references

HAN B , GOPALAKRISHNAN V , JI L , et al . Network function virtualization:challenges and opportunities for innovations [J ] . IEEE Communications Magazine , 2015 , 53 ( 2 ): 90 - 97 .

MIJUMBI R , SERRAT J , GORRICHO J L , et al . Network function virtualization:state-of-the-art and research challenges [J ] . IEEE Communications Surveys ＆ Tutorials , 2016 , 18 ( 1 ): 236 - 262 .

RIERA J F , ESCALONA E , BATALLÉ J , et al . Virtual network function scheduling:concept and challenges [C ] // 2014 International Conference on Smart Communications in Network Technologies (SaCoNeT) . 2014 : 1 - 5 .

MIJUMBI R , SERRAT J , GORRICHO J L , et al . Design and evaluation of algorithms for mapping and scheduling of virtual network functions [C ] // 2015 1st IEEE Conference on Network Softwarization (NetSoft) . 2015 : 1 - 9 .

KREUTZ D , RAMOS F M V , VERÍSSIMO P E , et al . Software-defined networking:a comprehensive survey [J ] . Proceedings of the IEEE , 2015 , 103 ( 1 ): 14 - 76 .

NUNES B A A , MENDONCA M , NGUYEN X N , et al . A survey of software-defined networking:past,present,and future of programmable networks [J ] . IEEE Communications Surveys ＆ Tutorials , 2014 , 16 ( 3 ): 1617 - 1634 .

LI Y , CHEN M . Software-defined network function virtualization:a survey [J ] . IEEE Access , 2015 , 3 : 2542 - 2553 .

BHAMARE D , JAIN R , SAMAKA M , et al . A survey on service function chaining [J ] . Journal of Network and Computer Applications , 2016 , 75 : 138 - 155 .

KUO T W , LIOU B H , LIN K C J , et al . Deploying chains of virtual network functions:on the relation between link and server usage [C ] // IEEE INFOCOM 2016-the 35th Annual IEEE International Conference on Computer Communications . 2016 : 1 - 9 .

MECHTRI M , GHRIBI C , ZEGHLACHE D . A scalable algorithm for the placement of service function chains [J ] . IEEE Transactions on Network and Service Management , 2016 , 13 ( 3 ): 533 - 546 .

WANG L , LU Z , WEN X , et al . Joint optimization of service function chaining and resource allocation in network function virtualization [J ] . IEEE Access , 2016 , 4 : 8084 - 8094 .

YE Z , CAO X , WANG J , et al . Joint topology design and mapping of service function chains for efficient,scalable,and reliable network functions virtualization [J ] . IEEE Network , 2016 , 30 ( 3 ): 81 - 87 .

REDDY V S , BAUMGARTNER A , BAUSCHERT T . Robust embedding of VNF/service chains with delay bounds [C ] // 2016 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN) . 2016 : 93 - 99 .

MEHRAGHDAM S , KELLER M , KARL H . Specifying and placing chains of virtual network functions [C ] // 2014 IEEE 3rd International Conference on Cloud Networking (CloudNet) . 2014 : 7 - 13 .

ZHANG Q , XIAO Y , LIU F , et al . Joint optimization of chain placement and request scheduling for network function virtualization [C ] // 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS) . 2017 : 731 - 741 .

HIRWE A , KATAOKA K . LightChain:a lightweight optimisation of VNF placement for service chaining in NFV [C ] // 2016 IEEE NetSoft Conference and Workshops (NetSoft) . 2016 : 33 - 37 .

ZHANG B , ZHANG P , ZHAO Y . Co-scaler:cooperative scaling of software-defined NFV service function chain [C ] // 2016 IEEE Conference on Network Function Virtualization and Software Defined Networks (NFV-SDN) . 2016 : 33 - 38 .

SAHHAF S , TAVERNIER W , COLLE D , et al . Network service chaining with efficient network function mapping based on service decompositions [C ] // 2015 1st IEEE Conference on Network Softwarization (NetSoft) . 2015 : 1 - 5 .

MOENS H , TURCK F D . Customizable function chains:managing service chain variability in hybrid NFV networks [J ] . IEEE Transactions on Network and Service Management , 2016 , 13 ( 4 ): 711 - 724 .

FEI X , LIU F , XU H , et al . Towards load-balanced VNF assignment in geo-distributed NFV Infrastructure [C ] // IEEE/ACM 25th International Symposium on Quality of Service (IWQoS) . 2017 : 1 - 10 .

DIETRICH D , ABUJODA A , RIZK A , et al . Multi-provider service chain embedding with nestor [J ] . IEEE Transactions on Network and Service Management , 2017 , 14 ( 1 ): 91 - 105 .

HABIB A , KHAN M I . Reinforcement learning based autonomic virtual machine management in clouds [C ] // 2016 5th International Conference on Informatics,Electronics and Vision (ICIEV) . 2016 : 1083 - 1088 .

GROLÉAT T , POUYLLAU H . Distributed inter-domain SLA negotiation using Reinforcement Learning [C ] // 12th IFIP/IEEE International Symposium on Integrated Network Management (IM 2011)and Workshops . 2011 : 33 - 40 .

LIN S C , AKYILDIZ I F , WANG P , et al . QoS-aware adaptive routing in multi-layer hierarchical software defined networks:a reinforcement learning approach [C ] // 2016 IEEE International Conference on Services Computing (SCC) . 2016 : 25 - 33 .

浏览量

2792

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于Q-learning的跨域服务链映射机制

端到端时延上限确定的服务链部署算法

MicroNF：基于微服务的异构网络功能虚拟化框架

基于离散粒子群优化的多目标服务路径构建算法

基于RL-WGAN的5G网络异常数据生成方法