Differential data update scheme on network-coding-based cloud storage system

Long-jiang WANG; Yue CHEN; Xin-cheng YAN; Kai-xiang HUANG

doi:10.11959/j.issn.1000-436x.2017045

您当前的位置：

首页 >

文章列表页 >

Differential data update scheme on network-coding-based cloud storage system

Correspondences | 更新时间：2024-06-05

- Differential data update scheme on network-coding-based cloud storage system
- Journal on Communications Vol. 38, Issue 3, Pages: 154-164(2017)
- 作者机构：
  
  解放军信息工程大学，河南郑州 450001
- 作者简介：
- 基金信息：
  
  The National Basic Research Program of China (973 Program)(2012CB315901);Key Technologies R & D Program of Henan Province(17210221001)
- DOI：10.11959/j.issn.1000-436x.2017045
  CLC： TP391
- Online First：2017-03，
  
  Published：15 March 2017
- 稿件说明：
移动端阅览
Long-jiang WANG, Yue CHEN, Xin-cheng YAN, et al. Differential data update scheme on network-coding-based cloud storage system[J]. Journal on Communications, 2017, 38(3): 154-164.
DOI：

Long-jiang WANG, Yue CHEN, Xin-cheng YAN, et al. Differential data update scheme on network-coding-based cloud storage system[J]. Journal on Communications, 2017, 38(3): 154-164. DOI： 10.11959/j.issn.1000-436x.2017045.

摘要

针对基于网络编码云存储系统数据更新时通信开销过大的问题，提出一种差分数据更新方案，通过对文件中更新部分进行编码和压缩传输，降低了更新过程中的通信开销。设计实现了基于网络编码的云存储原型系统，在真实网络环境中进行部署和测试，实验结果表明，与现有更新方案相比，所提方案通信开销更小，具有更好的可扩展性。

Abstract

In order to solve the problem that the communication overhead of date update was too large on network-coding-based cloud storage system

a new differential data update scheme was proposed.By encoding and compressing the updated part of file

the communication overhead was reduced significantly.A network-coding-based storage prototype system was designed and implemented

and update scheme was deployed in the real network settings.Experimental results show that the proposed scheme has less communication overhead and better scalability than the existing schemes.

关键词

Keywords

references

HASHEM I A T , YAQOOB I , ANUAR N B , et al . The rise of “big data” on cloud computing:review and open research issues [J ] . Information Systems , 2014 , 47 ( 47 ): 98 - 115 .

JIEHUI J U , JIYI W U , JIANQING F U , et al . A survey on cloud storage [J ] . Journal of Computers , 2011 , 6 ( 8 ): 1764 - 1771 .

Amazon . What is Amazon S3? [J ] . Amazon Simple Storage Service Developer Guide , 2006 .

LI H . Introducing windows azure [J ] . David Chappell & Associates White Paper , 2010 .

ZAKERINASAB M R , WANG M . DeltaNC:efficient file updates for network-coding-based cloud storage systems [C ] // IEEE International Symposium on Modelling,Analysis & Simulation of Computer and Telecommunication Systems . 2013 : 360 - 364 .

HU Y , LEE P P C , SHUM K W . Analysis and construction of functional regenerating codes with uncoded repair for distributed storage systems [C ] // IEEE INFOCOM . 2012 : 2355 - 2363 .

罗象宏 , 舒继武 . 存储系统中的纠删码研究综述 [J ] . 计算机研究与发展 , 2012 , 49 ( 1 ): 1 - 11 .

LUO X H , SHU J W . Summary of research for erasure code in storage system [J ] . Journal of Computer Research and Development , 2012 , 49 ( 1 ): 1 - 11 .

LI J , LI B . Erasure coding for cloud storage systems:a survey [J ] . Tsinghua Science & Technology , 2013 , 18 ( 3 ): 259 - 272 .

RASHMI K V , SHAH N B , GU D , et al . A solution to the network challenges of data recovery in erasure-coded distributed storage systems:a study on the facebook warehouse cluster [J ] . Usenix Hotstorage , 2013 :8.

REED I S , SOLOMON G . Polynomial codes over certain finite fields [J ] . Journal of the Society for Industrial & Applied Mathematics , 1960 , 8 ( 2 ): 300 - 304 .

PLANK , JAMES S . A tutorial on Reed-Solomon coding for fault-tolerance in RAID-like systems [J ] . Software—practice & Experience , 1996 , 27 ( 9 ): 995 - 1012 .

DIMAKIS A G , GODFREY P B , WU Y , et al . Network coding for distributed storage systems [J ] . IEEE Transactions on Information Theory , 2007 , 56 ( 9 ): 2000 - 2008 .

BLOMER J , KALFANE M , KARP R , et al . An XOR-based erasure-resilient coding scheme [C ] // Proc Acm Sigcomm . 1999 .

BLAUM M , BRADY J , BRUCK J , et al . EVENODD:an efficient scheme for tolerating double disk failures in RAID architectures [J ] . IEEE Transactions on Computers , 1995 , 44 ( 2 ): 192 - 202 .

CORBETT P , ENGLISH B , GOEL A , et al . Row-diagonal parity for double disk failure correction [C ] // 3rd USENIX Symposium on File and Storage Technologies (FAST'04) , 2014 : 1 - 14 .

GHEMAWAT S , GOBIOFF H , LEUNG S T . The Google file system [J ] . ACM Sigops Operating Systems Review , 2003 , 37 ( 5 ): 29 - 43 .

DHRUBA B . HDFS architecture guide [Z ] . Hadoop , 2008 .

AHLSWEDE R , CAI N , LI S Y R , et al . Network information flow [J ] . Fundamenta Informaticae , 2006 , 72 ( 1-3 ): 167 - 180 .

GKANTSIDIS C , RODRIGUEZ P R . Network coding for large scale content distribution [C ] // Infocom,Joint Conference of the IEEE Computer & Communications Societies . 2005 : 2235 - 2245 .

DIMAKIS A G , GODFREY P B , WAINWRIGHT M J , et al . Network coding for distributed storage systems [C ] // IEEE INFOCOM 2007-26th IEEE International Conference on Computer Communications . 2007 : 2000 - 2008 .

DIMAKIS A G , GODFREY P B , WU Y , et al . Network coding for distributed storage systems [J ] . IEEE Transactions on Information Theory , 2010 , 56 ( 9 ): 4539 - 4551 .

HU Y , YU C M , LI Y K , et al . NCFS:on the practicality and extensibility of a network-coding-based distributed file system [C ] // International Symposium on Network Coding . 2011 : 1 - 6 .

RASHMI K V , SHAH N B , KUMAR P V . Optimal exact-regenerating codes for distributed storage at the MSR and MBR points via a product-matrix construction [J ] . IEEE Transactions on Information Theory , 2011 , 57 ( 57 ): 5227 - 5239 .

RASHMI K V , SHAH N B , KUMAR P V , et al . Explicit construction of optimal exact regenerating codes for distributed storage [C ] // 47th Annual Allerton Conference on Communication,Control,and Computing , 2009 : 1243 - 1249 .

CHEN H C H , HU Y , LEE P P C , et al . NCCloud:a network-codingbased storage system in a cloud-of-clouds [J ] . IEEE Transactions on Computers , 2014 , 63 ( 1 ): 31 - 44 .

CHESTERFIELD J , RODRIGUEZ P . DeltaCast:efficient file reconciliation in wireless broadcast systems [C ] // International Conference on Mobile Systems,Applications,and Services . 2005 : 93 - 106 .

IRMAK U , MIHAYLOV S , SUEL T . Improved single-round protocols for remote file synchronization [J ] . Proceedings-IEEE INFOCOM , 2005 , 3 : 1665 - 1676 .

MOHAMMAD R Z , WANG M . An update model for network coding in cloud storage systems [C ] // Communication,Control,and Computing . 2012 : 1158 - 1165 .

ZHANG M , NEMAT A B , BLISS D E . Galois field multiplication system and method:US,US7526518 [P ] . 2009 .

RATH N , SZEREDI M , et al . FUSE [DB ] . 2009 - 10 - 15 .

Views

1979

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Mimic storage scheme based on regenerated code

Data update algorithm based on secure network coding in cloud environment

Query recovery attacks against conjunctive keyword searchable encryption

Attribute-based bilateral access control scheme for cloud storage

Blockchain-based and verifiable multidimensional data aggregation and sharing scheme for smart grid

Related Author

Yue CHEN

Longjiang WANG

Xincheng YAN

Xinyue ZHANG

Hao WU

Cheng-zhe LAI

Jiu-lun FAN

Jian-hua LIU

Related Institution

College of Target and Data Engineering,PLA Information Engineering University

Unit of PLA

School of Communication and Information Engineering, Xi’an University of Posts and Telecommunications

Information Centre,Xi’an University of Posts and Telecommunications

School of Cyber Science and Engineering, Wuhan University

AI问答

⁰