Ceph云存储网络中一种业务优先级区分的多播流调度方法

柯文龙; 王勇; 叶苗; 陈俊奇

doi:10.11959/j.issn.1000-436x.2020233

您当前的位置：

首页 >

文章列表页 >

Ceph云存储网络中一种业务优先级区分的多播流调度方法

学术论文 | 更新时间：2024-06-05

- Ceph云存储网络中一种业务优先级区分的多播流调度方法
- Priority differentiated multicast flow scheduling method in Ceph cloud storage network
- 通信学报 2020年41卷第11期页码：40-51
- 作者机构：
  
  1. 桂林电子科技大学信息与通信学院，广西桂林 541004
  2. 桂林电子科技大学计算机与信息安全学院，广西桂林 541004
  3. 桂林电子科技大学认知无线电与信息处理省部共建教育部重点实验室，广西桂林 541004
- 作者简介：
  
  [ "柯文龙（1989- ），男，安徽铜陵人，桂林电子科技大学博士生，主要研究方向为云存储系统网络、软件定义网络等" ]
  [ "王勇（1964- ），男，四川南充人，博士，桂林电子科技大学教授、博士生导师，主要研究方向为云计算、分布式存储系统、信息安全等" ]
  [ "叶苗（1977- ），男，广西桂林人，博士，桂林电子科技大学教授、博士生导师，主要研究方向为分布式存储、无线传感器网络、工程中的优化理论与方法、模式识别与机器学习" ]
  [ "陈俊奇（1997- ），男，湖南邵阳人，桂林电子科技大学硕士生，主要研究方向为云存储系统、软件定义网络等" ]
- 基金信息：
  
  国家自然科学基金资助项目(61861013);国家自然科学基金资助项目(61662018);广西创新驱动发展专项_科技重大专项基金资助项目(桂科AA18118031);广西自然科学基金资助项目(2018GXNSFAA050028);“认知无线电与信息处理”教育部重点实验室主任基金资助项目(CRKL190102);广西高校中青年教师科研基础能力提升基金资助项目(2019KY0822)
- DOI：10.11959/j.issn.1000-436x.2020233
  中图分类号： TP393
- 网络出版日期：2020-11，
  
  纸质出版日期：2020-11-25
- 稿件说明：
移动端阅览
柯文龙, 王勇, 叶苗, 等. Ceph云存储网络中一种业务优先级区分的多播流调度方法[J]. 通信学报, 2020,41(11):40-51.

Wenlong KE, Yong WANG, Miao YE, et al. Priority differentiated multicast flow scheduling method in Ceph cloud storage network[J]. Journal on communications, 2020, 41(11): 40-51.
柯文龙, 王勇, 叶苗, 等. Ceph云存储网络中一种业务优先级区分的多播流调度方法[J]. 通信学报, 2020,41(11):40-51. DOI： 10.11959/j.issn.1000-436x.2020233.

Wenlong KE, Yong WANG, Miao YE, et al. Priority differentiated multicast flow scheduling method in Ceph cloud storage network[J]. Journal on communications, 2020, 41(11): 40-51. DOI： 10.11959/j.issn.1000-436x.2020233.

摘要

摘要:针对现有流调度方法难以满足 Ceph 云存储网络中多业务流的不同多播调度需求问题，设计了一种支持业务优先级区分的多播流调度方法。首先，采用软件定义网络技术实时获取网络状态信息，为流调度方法提供数据支撑；然后，将待处理的多播流调度任务分解为多个单播路径选择的多属性决策问题，提出基于理想解法的单播路径选择方法，根据业务流对网络性能的需求为其找到一个最优单播路径集；最后，通过各路径集间的最大公共子路径确定多播分发节点以构建多播传输路径。实验结果表明，与现有方法相比，所提方法可以在降低冗余流量、提高网络负载均衡性能的同时，降低高优先级流的传输时延。

Abstract

In order to solve the problem that existing flow scheduling method is difficult to meet the different multicast scheduling requirements of multi-service flows in the Ceph cloud storage network

a service priority-based multicast flow scheduling method was tailored.First

the network status was obtained via software defined network (SDN) to support flow scheduling.Then

a multicast task was decomposed into multiple attribute decision problems for multiple unicast path selection

and a method of unicast path selection based on technique for order preference by similarity to ideal solution (TOPSIS) was proposed.The unicast path selection method was used to find the optimal unicast path set for the service flow based on the flow’s network performance requirements.Then

the multicast distribution node was determined by the maximum common sub-path among the optimal unicast path sets for construct a multicast transmission path.The experiment results show that the proposed method can reduce the transmission delay of high priority flows while reduce the redundant traffic and better balance the traffic loads compared with the existing methods.

关键词

Keywords

references

NIELSEN L , VESTERGAARD R , YAZDANI N , et al . Alexandria:a proof-of-concept implementation and evaluation of generalised data deduplication [C ] // 2019 IEEE Global Communications Conference (GLOBECOM) . Piscataway:IEEE Press , 2019 : 1 - 6 .

ZHANG Y , WEI Q S , CHEN C , et al . Dynamic scheduling with service curve for QoS guarantee of large-scale cloud storage [J ] . IEEE Transactions on Computers , 2018 , 67 ( 4 ): 457 - 468 .

YANG C T , LIU J C , KRISTIANI E , et al . NetFlow monitoring and cyberattack detection using deep learning with Ceph [J ] . IEEE Access , 2020 , 8 : 7842 - 7850 .

CHOWDHURY M , ZHONG Y , STOICA I . Efficient coflow scheduling with varys [J ] . ACM SIGCOMM Computer Communication Review , 2014 , 44 ( 4 ): 443 - 454 .

FAN F J , HU B , YEUNG K L , et al . Mini forest:distributed and dynamic multicasting in datacenter networks [J ] . IEEE Transactions on Network and Service Management , 2019 , 16 ( 3 ): 1268 - 1281 .

HUANG K , SU X . Scalable datacenter multicast using in-packet bitmaps [J ] . Distributed and Parallel Databases , 2018 , 36 ( 3 ): 445 - 460 .

WANG Y C , YOU S Y . An efficient route management framework for load balance and overhead reduction in SDN-based data center networks [J ] . IEEE Transactions on Network and Service Management , 2018 , 15 ( 4 ): 1422 - 1434 .

CUI W Z , QIAN C . Scalable and load-balanced data center multicast [C ] // 2015 IEEE Global Telecommunications Conference (GLOBECOM) . Piscataway:IEEE Press , 2015 : 1 - 6 .

ZHANG Y X , CUI L , ZHANG Y . A stable matching based elephant flow scheduling algorithm in data center networks [J ] . Computer Networks , 2017 , 120 : 186 - 197 .

SEHERY W , CLANCY C . Flow optimization in data centers with clos networks in support of cloud applications [J ] . IEEE Transactions on Network and Service Management , 2017 , 14 ( 4 ): 847 - 859 .

胡智尧 , 李东升 , 李紫阳 . 数据中心网络流调度技术前沿进展 [J ] . 计算机研究与发展 , 2018 , 55 ( 9 ): 1920 - 1930 .

HU Z Y , LI D S , LI Z Y . Recent advances in datacenter flow scheduling [J ] . Journal of Computer Research and Development , 2018 , 55 ( 9 ): 1920 - 1930 .

CHIESA M , KINDLER G , SCHAPIRA M . Traffic engineering with equal-cost-multipath:an algorithmic perspective [J ] . IEEE-ACM Transactions on Networking , 2017 , 25 ( 2 ): 779 - 792 .

AL-FARES M , RADHAKRISHNAN S , RAGHAVAN B , et al . Hedera:dynamic flow scheduling for data center networks [C ] // 2010 USENIX Conference on Networked System Design and Implementation (NSDI) . Berkeley:USENIX Press , 2010 :19.

HONG C Y , CAESAR M , GODFREY P B . Finishing flows quickly with preemptive scheduling [J ] . ACM SIGCOMM Computer Communication Review , 2012 , 42 ( 4 ): 127 - 138 .

ALIZADEH M , YANG S , SHARIF M , et al . pFabric:minimal near-optimal datacenter transport [J ] . ACM SIGCOMM Computer Communication Review , 2013 , 43 ( 4 ): 435 - 446 .

郑成渝 , 焦博 , 王军 , 等 . 基于可计算网络的SDN视频总线系统架构研究 [J ] . 通信学报 , 2018 , 39 ( Z1 ): 271 - 277 .

ZHENG C Y , JIAO B , WANG J , et al . Research on SDN video bus system architecture based on computable network [J ] . Journal on Communications , 2018 , 39 ( Z1 ): 271 - 277 .

ISLAM S , MUSLIM N , ATWOOD J W . A survey on multicasting in software-defined networking [J ] . IEEE Communications Surveys and Tutorials , 2018 , 20 ( 1 ): 355 - 387 .

ALSAEED Z , AHMAD I , HUSSAIN I . Multicasting in software defined networks:a comprehensive survey [J ] . Journal of Network and Computer Applications , 2018 , 104 : 61 - 77 .

LEE M W , LI Y S , HUANG X , et al . Robust multipath multicast routing algorithms for videos in software-defined networks [C ] // 2014 IEEE International Symposium of Quality of Service (IWQoS) . Piscataway:IEEE Press , 2014 : 218 - 227 .

GUO Z Y , DUAN J , YANG Y Y . On-line multicast scheduling with bounded congestion in fat-tree data center networks [J ] . IEEE Journal on Selected Areas in Communications , 2014 , 32 ( 1 ): 102 - 115 .

LI G Z , GUO S T , YANG Y Y . Multicast scheduling algorithm in software defined fat-tree data center networks [C ] // 2017 IEEE International Symposium of Quality of Service (IWQoS) . Piscataway:IEEE Press , 2017 : 127 - 135 .

LI G Z , GUO S T , LIU G Y , et al . Multicast scheduling with Markov chains in fat-tree data center networks [C ] // 2017 International Conference on Networking,Architecture,and Storage (NAS) . Piscataway:IEEE Press , 2017 : 188 - 194 .

GEORGOPOULOS P , ELKHATIB Y , BROADBENT M , et al . Towards network-wide QoE fairness using openflow-assisted adaptive video streaming [C ] // 2013 ACM SIGCOMM Workshop on Future Human-Centric Multimedia Networking (FhMN) . New York:ACM Press , 2013 : 15 - 20 .

AMIRI M , ALOSMAN H , SHIRMOHAMMADI S , et al . Towarddelay-efficient game-aware data centers for cloud gaming [J ] . ACM Transactions on Multimedia Computing Communications and Applications , 2016 , 12 ( 5s ): 1 - 19 .

ZHU T W , FENG D , WANG F , et al . A congestion-aware and robust multicast protocol in SDN-based data center networks [J ] . Journal of Network and Computer Applications , 2017 , 95 : 105 - 117 .

ABDELMONIEM A M , BENSAOU B , ABU A J . Mitigating incast-TCP congestion in data centers with SDN [J ] . Annals of Telecommunications , 2017 , 73 ( 3-4 ): 263 - 277 .

王勇 , 叶苗 , 何倩 , 等 . 基于软件定义网络和多属性决策的Ceph存储系统节点选择方法 [J ] . 计算机学报 , 2019 , 42 ( 2 ): 93 - 108 .

WANG Y , YE M , HE Q , et al . A new node selecting approach in Ceph storage system based on software defined network and multi-attributes decision-making model [J ] . Chinese Journal of Computers , 2019 , 42 ( 2 ): 93 - 108 .

BARBEHENN M . A note on the complexity of Dijkstra's algorithm for graphs with weighted vertices [J ] . IEEE Transactions on Computers , 1998 , 47 ( 2 ): 263 - 263 .

LUO Y Q , XIA J B , CHEN T P . Comparison of objective weight determination methods in network performance evaluation [J ] . Journal of Computer Application , 2009 , 29 ( 10 ): 2624 - 2626 .

LANTZ B , O’CONNOR B . A mininet-based virtual testbed for distributed SDN development [J ] . ACM SIGCOMM Computer Communication Review , 2015 , 45 ( 4 ): 365 - 366 .

ISLAM M T , ISLAM N , ALREFAT M . Node to node performance evaluation through RYU SDN controller [J ] . Wireless Personal Communications , 2020 , 112 ( 1 ): 555 - 570

HONG S S , WONG F , WU S F . TCPtransform:property-oriented TCP traffic transformation [J ] . Lecture Notes in Computer Science , 2005 , 3548 : 222 - 240 .

KE W L , WANG Y , YE M . GRSA:service-aware flow scheduling for cloud storage datacenter networks [J ] . China Communications , 2020 , 17 ( 6 ): 164 - 179 .

浏览量

297

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

节点链路同时映射的多类型服务资源编排算法

基于斐波那契树优化算法的数据中心流量调度策略

基于时延的LEO卫星网络SDN控制器动态放置方法

基于SDN节点淆乱机制的接收方不可追踪的混合匿名通道

软件定义网络及安全防御技术研究