通信学报2023,Vol.44Issue(11):213-224,12.DOI:10.11959/j.issn.1000-436x.2023217
xStripeMerge:基于纠删码存储的高效宽条带生成方法
xStripeMerge:efficient wide stripe generation approach based on erasure coding storage
摘要
Abstract
To address the issue of wide stripe generation in existing erasure coding storage systems,where storage scaling approaches resulted in a significant increase in wide stripe generation bandwidth and stripe merge scheme was con-strained by dual-stripes,an efficient wide stripe generation approach was proposed for the wide stripe generation problem under multi stripes merging.Two key operators for the multi-stripes merging progress were defined,and the wide stripe generation problem was modeled as a combinatorial optimization problem.The efficient wide stripe generation approach xStripeMerge was proposed that prioritize the search for narrow-stripes combining schemes with small parity block transmission costs.Experimental results show that xStripeMerge can reduce the wide stripe generation bandwidth by 75%compared to the advanced storage scaling method.The time and space complexity of xStripeMerge is much better than that of the extended dual-stripes merge approach.xStripeMerge can get the wide stripe generation scheme with similar performance in a shorter period of time and it is also suitable for large-scale storage systems.关键词
分布式存储/纠删码/宽条带/条带合并/奇偶块对齐Key words
distributed storage/erasure coding/wide stripe/stripe merge/parity align分类
信息技术与安全科学引用本文复制引用
郑美光,化韬斐,张心宇,胡志刚..xStripeMerge:基于纠删码存储的高效宽条带生成方法[J].通信学报,2023,44(11):213-224,12.基金项目
国家自然科学基金资助项目(No.62172442,No.62172451) (No.62172442,No.62172451)
湖南省自然科学基金青年基金资助项目(No.2020JJ5775)The National Natural Science Foundation of China(No.62172442,No.62172451),Youth Science Foundation of Natural Science Foundation of Hunan Province(No.2020JJ5775) (No.2020JJ5775)