Priority differentiated multicast flow scheduling method in Ceph cloud storage network

Wenlong KE; Yong WANG; Miao YE; Junqi CHEN

doi:10.11959/j.issn.1000-436x.2020233

您当前的位置：

首页 >

文章列表页 >

Priority differentiated multicast flow scheduling method in Ceph cloud storage network

Papers | 更新时间：2024-06-05

- Priority differentiated multicast flow scheduling method in Ceph cloud storage network
- Journal on Communications Vol. 41, Issue 11, Pages: 40-51(2020)
- 作者机构：
  
  1. 桂林电子科技大学信息与通信学院，广西桂林 541004
  2. 桂林电子科技大学计算机与信息安全学院，广西桂林 541004
  3. 桂林电子科技大学认知无线电与信息处理省部共建教育部重点实验室，广西桂林 541004
- 作者简介：
- 基金信息：
  
  The National Natural Science Foundation of China(61861013);The National Natural Science Foundation of China(61662018);Guangxi Innovation-Driven Development Project(桂科AA18118031);Guangxi Natural Science Foundation of China(2018GXNSFAA050028);Director Fund Project of Key Laboratory of Cognitive Radio and Information Processing of Ministry of Education(CRKL190102);Guangxi Colleges and Universities Basic Ability Improvement Project of Young and Middle-Aged Teachers(2019KY0822)
- DOI：10.11959/j.issn.1000-436x.2020233
  CLC： TP393
- Online First：2020-11，
  
  Published：25 November 2020
- 稿件说明：
移动端阅览
Wenlong KE, Yong WANG, Miao YE, et al. Priority differentiated multicast flow scheduling method in Ceph cloud storage network[J]. Journal on Communications, 2020, 41(11): 40-51.
DOI：

Wenlong KE, Yong WANG, Miao YE, et al. Priority differentiated multicast flow scheduling method in Ceph cloud storage network[J]. Journal on Communications, 2020, 41(11): 40-51. DOI： 10.11959/j.issn.1000-436x.2020233.

摘要

摘要:针对现有流调度方法难以满足 Ceph 云存储网络中多业务流的不同多播调度需求问题，设计了一种支持业务优先级区分的多播流调度方法。首先，采用软件定义网络技术实时获取网络状态信息，为流调度方法提供数据支撑；然后，将待处理的多播流调度任务分解为多个单播路径选择的多属性决策问题，提出基于理想解法的单播路径选择方法，根据业务流对网络性能的需求为其找到一个最优单播路径集；最后，通过各路径集间的最大公共子路径确定多播分发节点以构建多播传输路径。实验结果表明，与现有方法相比，所提方法可以在降低冗余流量、提高网络负载均衡性能的同时，降低高优先级流的传输时延。

Abstract

In order to solve the problem that existing flow scheduling method is difficult to meet the different multicast scheduling requirements of multi-service flows in the Ceph cloud storage network

a service priority-based multicast flow scheduling method was tailored.First

the network status was obtained via software defined network (SDN) to support flow scheduling.Then

a multicast task was decomposed into multiple attribute decision problems for multiple unicast path selection

and a method of unicast path selection based on technique for order preference by similarity to ideal solution (TOPSIS) was proposed.The unicast path selection method was used to find the optimal unicast path set for the service flow based on the flow’s network performance requirements.Then

the multicast distribution node was determined by the maximum common sub-path among the optimal unicast path sets for construct a multicast transmission path.The experiment results show that the proposed method can reduce the transmission delay of high priority flows while reduce the redundant traffic and better balance the traffic loads compared with the existing methods.

关键词

Keywords

references

NIELSEN L , VESTERGAARD R , YAZDANI N , et al . Alexandria:a proof-of-concept implementation and evaluation of generalised data deduplication [C ] // 2019 IEEE Global Communications Conference (GLOBECOM) . Piscataway:IEEE Press , 2019 : 1 - 6 .

ZHANG Y , WEI Q S , CHEN C , et al . Dynamic scheduling with service curve for QoS guarantee of large-scale cloud storage [J ] . IEEE Transactions on Computers , 2018 , 67 ( 4 ): 457 - 468 .

YANG C T , LIU J C , KRISTIANI E , et al . NetFlow monitoring and cyberattack detection using deep learning with Ceph [J ] . IEEE Access , 2020 , 8 : 7842 - 7850 .

CHOWDHURY M , ZHONG Y , STOICA I . Efficient coflow scheduling with varys [J ] . ACM SIGCOMM Computer Communication Review , 2014 , 44 ( 4 ): 443 - 454 .

FAN F J , HU B , YEUNG K L , et al . Mini forest:distributed and dynamic multicasting in datacenter networks [J ] . IEEE Transactions on Network and Service Management , 2019 , 16 ( 3 ): 1268 - 1281 .

HUANG K , SU X . Scalable datacenter multicast using in-packet bitmaps [J ] . Distributed and Parallel Databases , 2018 , 36 ( 3 ): 445 - 460 .

WANG Y C , YOU S Y . An efficient route management framework for load balance and overhead reduction in SDN-based data center networks [J ] . IEEE Transactions on Network and Service Management , 2018 , 15 ( 4 ): 1422 - 1434 .

CUI W Z , QIAN C . Scalable and load-balanced data center multicast [C ] // 2015 IEEE Global Telecommunications Conference (GLOBECOM) . Piscataway:IEEE Press , 2015 : 1 - 6 .

ZHANG Y X , CUI L , ZHANG Y . A stable matching based elephant flow scheduling algorithm in data center networks [J ] . Computer Networks , 2017 , 120 : 186 - 197 .

SEHERY W , CLANCY C . Flow optimization in data centers with clos networks in support of cloud applications [J ] . IEEE Transactions on Network and Service Management , 2017 , 14 ( 4 ): 847 - 859 .

胡智尧 , 李东升 , 李紫阳 . 数据中心网络流调度技术前沿进展 [J ] . 计算机研究与发展 , 2018 , 55 ( 9 ): 1920 - 1930 .

HU Z Y , LI D S , LI Z Y . Recent advances in datacenter flow scheduling [J ] . Journal of Computer Research and Development , 2018 , 55 ( 9 ): 1920 - 1930 .

CHIESA M , KINDLER G , SCHAPIRA M . Traffic engineering with equal-cost-multipath:an algorithmic perspective [J ] . IEEE-ACM Transactions on Networking , 2017 , 25 ( 2 ): 779 - 792 .

AL-FARES M , RADHAKRISHNAN S , RAGHAVAN B , et al . Hedera:dynamic flow scheduling for data center networks [C ] // 2010 USENIX Conference on Networked System Design and Implementation (NSDI) . Berkeley:USENIX Press , 2010 :19.

HONG C Y , CAESAR M , GODFREY P B . Finishing flows quickly with preemptive scheduling [J ] . ACM SIGCOMM Computer Communication Review , 2012 , 42 ( 4 ): 127 - 138 .

ALIZADEH M , YANG S , SHARIF M , et al . pFabric:minimal near-optimal datacenter transport [J ] . ACM SIGCOMM Computer Communication Review , 2013 , 43 ( 4 ): 435 - 446 .

郑成渝 , 焦博 , 王军 , 等 . 基于可计算网络的SDN视频总线系统架构研究 [J ] . 通信学报 , 2018 , 39 ( Z1 ): 271 - 277 .

ZHENG C Y , JIAO B , WANG J , et al . Research on SDN video bus system architecture based on computable network [J ] . Journal on Communications , 2018 , 39 ( Z1 ): 271 - 277 .

ISLAM S , MUSLIM N , ATWOOD J W . A survey on multicasting in software-defined networking [J ] . IEEE Communications Surveys and Tutorials , 2018 , 20 ( 1 ): 355 - 387 .

ALSAEED Z , AHMAD I , HUSSAIN I . Multicasting in software defined networks:a comprehensive survey [J ] . Journal of Network and Computer Applications , 2018 , 104 : 61 - 77 .

LEE M W , LI Y S , HUANG X , et al . Robust multipath multicast routing algorithms for videos in software-defined networks [C ] // 2014 IEEE International Symposium of Quality of Service (IWQoS) . Piscataway:IEEE Press , 2014 : 218 - 227 .

GUO Z Y , DUAN J , YANG Y Y . On-line multicast scheduling with bounded congestion in fat-tree data center networks [J ] . IEEE Journal on Selected Areas in Communications , 2014 , 32 ( 1 ): 102 - 115 .

LI G Z , GUO S T , YANG Y Y . Multicast scheduling algorithm in software defined fat-tree data center networks [C ] // 2017 IEEE International Symposium of Quality of Service (IWQoS) . Piscataway:IEEE Press , 2017 : 127 - 135 .

LI G Z , GUO S T , LIU G Y , et al . Multicast scheduling with Markov chains in fat-tree data center networks [C ] // 2017 International Conference on Networking,Architecture,and Storage (NAS) . Piscataway:IEEE Press , 2017 : 188 - 194 .

GEORGOPOULOS P , ELKHATIB Y , BROADBENT M , et al . Towards network-wide QoE fairness using openflow-assisted adaptive video streaming [C ] // 2013 ACM SIGCOMM Workshop on Future Human-Centric Multimedia Networking (FhMN) . New York:ACM Press , 2013 : 15 - 20 .

AMIRI M , ALOSMAN H , SHIRMOHAMMADI S , et al . Towarddelay-efficient game-aware data centers for cloud gaming [J ] . ACM Transactions on Multimedia Computing Communications and Applications , 2016 , 12 ( 5s ): 1 - 19 .

ZHU T W , FENG D , WANG F , et al . A congestion-aware and robust multicast protocol in SDN-based data center networks [J ] . Journal of Network and Computer Applications , 2017 , 95 : 105 - 117 .

ABDELMONIEM A M , BENSAOU B , ABU A J . Mitigating incast-TCP congestion in data centers with SDN [J ] . Annals of Telecommunications , 2017 , 73 ( 3-4 ): 263 - 277 .

王勇 , 叶苗 , 何倩 , 等 . 基于软件定义网络和多属性决策的Ceph存储系统节点选择方法 [J ] . 计算机学报 , 2019 , 42 ( 2 ): 93 - 108 .

WANG Y , YE M , HE Q , et al . A new node selecting approach in Ceph storage system based on software defined network and multi-attributes decision-making model [J ] . Chinese Journal of Computers , 2019 , 42 ( 2 ): 93 - 108 .

BARBEHENN M . A note on the complexity of Dijkstra's algorithm for graphs with weighted vertices [J ] . IEEE Transactions on Computers , 1998 , 47 ( 2 ): 263 - 263 .

LUO Y Q , XIA J B , CHEN T P . Comparison of objective weight determination methods in network performance evaluation [J ] . Journal of Computer Application , 2009 , 29 ( 10 ): 2624 - 2626 .

LANTZ B , O’CONNOR B . A mininet-based virtual testbed for distributed SDN development [J ] . ACM SIGCOMM Computer Communication Review , 2015 , 45 ( 4 ): 365 - 366 .

ISLAM M T , ISLAM N , ALREFAT M . Node to node performance evaluation through RYU SDN controller [J ] . Wireless Personal Communications , 2020 , 112 ( 1 ): 555 - 570

HONG S S , WONG F , WU S F . TCPtransform:property-oriented TCP traffic transformation [J ] . Lecture Notes in Computer Science , 2005 , 3548 : 222 - 240 .

KE W L , WANG Y , YE M . GRSA:service-aware flow scheduling for cloud storage datacenter networks [J ] . China Communications , 2020 , 17 ( 6 ): 164 - 179 .

Views

527

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Node-link simultaneous mapping based multi-type service resource orchestration algorithm

Data center traffic scheduling strategy based on Fibonacci tree optimization algorithm

Dynamic SDN controller placement based on latency in LEO satellite network

Hybrid anonymous channel for recipient untraceability via SDN-based node obfuscation scheme

Research on software-defined network and the security defense technology

Related Author

ZHANG Xu

MA Tianchun

GUO Lei

FENG Chuan

Xinling SHI

Songhai ZHANG

Yi DONG

Xia WANG

Related Institution

Key Laboratory of Big Data Intelligent Computing, Chongqing University of Posts and Telecommunications

School of Communications and Information Engineering, Chongqing University of Posts and Telecommunications

Institute of Intelligent Communication and Network Security, Chongqing University of Posts and Telecommunications

School of Information Science ＆Engineering,Yunnan University

China Telecom.Limited Co.Kunming Branch

AI问答

⁰