网络编码云存储系统差分数据更新方案

王龙江; 陈越; 严新成; 黄恺翔

doi:10.11959/j.issn.1000-436x.2017045

您当前的位置：

首页 >

文章列表页 >

网络编码云存储系统差分数据更新方案

学术通信 | 更新时间：2024-06-05

- 网络编码云存储系统差分数据更新方案
- Differential data update scheme on network-coding-based cloud storage system
- 通信学报 2017年38卷第3期页码：154-164
- 作者机构：
  
  解放军信息工程大学，河南郑州 450001
- 作者简介：
  
  [ "王龙江（1991-），男，陕西商洛人，解放军信息工程大学硕士生，主要研究方向为网络信息安全、云存储安全等。" ]
  [ "陈越（1965-），男，河南开封人，博士，解放军信息工程大学教授、博士生导师，主要研究方向为网络与信息安全。" ]
  [ "严新成（1991-），男，河南信阳人，解放军信息工程大学硕士生，主要研究方向为网络信息安全、基于机密的云数据访问控制。" ]
  [ "黄恺翔（1987-），男，河南新乡人，解放军信息工程大学博士生，主要研究方向为网络与信息安全等。" ]
- 基金信息：
  
  国家重点基础研究发展计划（“973”计划）基金资助项目(2012CB315901);河南省科技攻关计划基金资助项目(17210221001)
- DOI：10.11959/j.issn.1000-436x.2017045
  中图分类号： TP391
- 网络出版日期：2017-03，
  
  纸质出版日期：2017-03-15
- 稿件说明：
移动端阅览
王龙江, 陈越, 严新成, 等. 网络编码云存储系统差分数据更新方案[J]. 通信学报, 2017,38(3):154-164.

Long-jiang WANG, Yue CHEN, Xin-cheng YAN, et al. Differential data update scheme on network-coding-based cloud storage system[J]. Journal on communications, 2017, 38(3): 154-164.
王龙江, 陈越, 严新成, 等. 网络编码云存储系统差分数据更新方案[J]. 通信学报, 2017,38(3):154-164. DOI： 10.11959/j.issn.1000-436x.2017045.

Long-jiang WANG, Yue CHEN, Xin-cheng YAN, et al. Differential data update scheme on network-coding-based cloud storage system[J]. Journal on communications, 2017, 38(3): 154-164. DOI： 10.11959/j.issn.1000-436x.2017045.

摘要

针对基于网络编码云存储系统数据更新时通信开销过大的问题，提出一种差分数据更新方案，通过对文件中更新部分进行编码和压缩传输，降低了更新过程中的通信开销。设计实现了基于网络编码的云存储原型系统，在真实网络环境中进行部署和测试，实验结果表明，与现有更新方案相比，所提方案通信开销更小，具有更好的可扩展性。

Abstract

In order to solve the problem that the communication overhead of date update was too large on network-coding-based cloud storage system

a new differential data update scheme was proposed.By encoding and compressing the updated part of file

the communication overhead was reduced significantly.A network-coding-based storage prototype system was designed and implemented

and update scheme was deployed in the real network settings.Experimental results show that the proposed scheme has less communication overhead and better scalability than the existing schemes.

关键词

Keywords

references

HASHEM I A T , YAQOOB I , ANUAR N B , et al . The rise of “big data” on cloud computing:review and open research issues [J ] . Information Systems , 2014 , 47 ( 47 ): 98 - 115 .

JIEHUI J U , JIYI W U , JIANQING F U , et al . A survey on cloud storage [J ] . Journal of Computers , 2011 , 6 ( 8 ): 1764 - 1771 .

Amazon . What is Amazon S3? [J ] . Amazon Simple Storage Service Developer Guide , 2006 .

LI H . Introducing windows azure [J ] . David Chappell & Associates White Paper , 2010 .

ZAKERINASAB M R , WANG M . DeltaNC:efficient file updates for network-coding-based cloud storage systems [C ] // IEEE International Symposium on Modelling,Analysis & Simulation of Computer and Telecommunication Systems . 2013 : 360 - 364 .

HU Y , LEE P P C , SHUM K W . Analysis and construction of functional regenerating codes with uncoded repair for distributed storage systems [C ] // IEEE INFOCOM . 2012 : 2355 - 2363 .

罗象宏 , 舒继武 . 存储系统中的纠删码研究综述 [J ] . 计算机研究与发展 , 2012 , 49 ( 1 ): 1 - 11 .

LUO X H , SHU J W . Summary of research for erasure code in storage system [J ] . Journal of Computer Research and Development , 2012 , 49 ( 1 ): 1 - 11 .

LI J , LI B . Erasure coding for cloud storage systems:a survey [J ] . Tsinghua Science & Technology , 2013 , 18 ( 3 ): 259 - 272 .

RASHMI K V , SHAH N B , GU D , et al . A solution to the network challenges of data recovery in erasure-coded distributed storage systems:a study on the facebook warehouse cluster [J ] . Usenix Hotstorage , 2013 :8.

REED I S , SOLOMON G . Polynomial codes over certain finite fields [J ] . Journal of the Society for Industrial & Applied Mathematics , 1960 , 8 ( 2 ): 300 - 304 .

PLANK , JAMES S . A tutorial on Reed-Solomon coding for fault-tolerance in RAID-like systems [J ] . Software—practice & Experience , 1996 , 27 ( 9 ): 995 - 1012 .

DIMAKIS A G , GODFREY P B , WU Y , et al . Network coding for distributed storage systems [J ] . IEEE Transactions on Information Theory , 2007 , 56 ( 9 ): 2000 - 2008 .

BLOMER J , KALFANE M , KARP R , et al . An XOR-based erasure-resilient coding scheme [C ] // Proc Acm Sigcomm . 1999 .

BLAUM M , BRADY J , BRUCK J , et al . EVENODD:an efficient scheme for tolerating double disk failures in RAID architectures [J ] . IEEE Transactions on Computers , 1995 , 44 ( 2 ): 192 - 202 .

CORBETT P , ENGLISH B , GOEL A , et al . Row-diagonal parity for double disk failure correction [C ] // 3rd USENIX Symposium on File and Storage Technologies (FAST'04) , 2014 : 1 - 14 .

GHEMAWAT S , GOBIOFF H , LEUNG S T . The Google file system [J ] . ACM Sigops Operating Systems Review , 2003 , 37 ( 5 ): 29 - 43 .

DHRUBA B . HDFS architecture guide [Z ] . Hadoop , 2008 .

AHLSWEDE R , CAI N , LI S Y R , et al . Network information flow [J ] . Fundamenta Informaticae , 2006 , 72 ( 1-3 ): 167 - 180 .

GKANTSIDIS C , RODRIGUEZ P R . Network coding for large scale content distribution [C ] // Infocom,Joint Conference of the IEEE Computer & Communications Societies . 2005 : 2235 - 2245 .

DIMAKIS A G , GODFREY P B , WAINWRIGHT M J , et al . Network coding for distributed storage systems [C ] // IEEE INFOCOM 2007-26th IEEE International Conference on Computer Communications . 2007 : 2000 - 2008 .

DIMAKIS A G , GODFREY P B , WU Y , et al . Network coding for distributed storage systems [J ] . IEEE Transactions on Information Theory , 2010 , 56 ( 9 ): 4539 - 4551 .

HU Y , YU C M , LI Y K , et al . NCFS:on the practicality and extensibility of a network-coding-based distributed file system [C ] // International Symposium on Network Coding . 2011 : 1 - 6 .

RASHMI K V , SHAH N B , KUMAR P V . Optimal exact-regenerating codes for distributed storage at the MSR and MBR points via a product-matrix construction [J ] . IEEE Transactions on Information Theory , 2011 , 57 ( 57 ): 5227 - 5239 .

RASHMI K V , SHAH N B , KUMAR P V , et al . Explicit construction of optimal exact regenerating codes for distributed storage [C ] // 47th Annual Allerton Conference on Communication,Control,and Computing , 2009 : 1243 - 1249 .

CHEN H C H , HU Y , LEE P P C , et al . NCCloud:a network-codingbased storage system in a cloud-of-clouds [J ] . IEEE Transactions on Computers , 2014 , 63 ( 1 ): 31 - 44 .

CHESTERFIELD J , RODRIGUEZ P . DeltaCast:efficient file reconciliation in wireless broadcast systems [C ] // International Conference on Mobile Systems,Applications,and Services . 2005 : 93 - 106 .

IRMAK U , MIHAYLOV S , SUEL T . Improved single-round protocols for remote file synchronization [J ] . Proceedings-IEEE INFOCOM , 2005 , 3 : 1665 - 1676 .

MOHAMMAD R Z , WANG M . An update model for network coding in cloud storage systems [C ] // Communication,Control,and Computing . 2012 : 1158 - 1165 .

ZHANG M , NEMAT A B , BLISS D E . Galois field multiplication system and method:US,US7526518 [P ] . 2009 .

RATH N , SZEREDI M , et al . FUSE [DB ] . 2009 - 10 - 15 .

浏览量

1158

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于再生码的拟态数据存储方案

云环境下基于安全网络编码的数据更新算法

面向连接关键词可搜索加密的查询恢复攻击

面向云存储的属性基双边访问控制方案

基于区块链且可验证的智能电网多维数据聚合与分享方案