xStripeMerge:基于纠删码存储的高效宽条带生成方法OACSCD
xStripeMerge:efficient wide stripe generation approach based on erasure coding storage
为了解决纠删码存储系统的已有宽条带生成方法中扩容方案将产生大量宽条带生成带宽,合并方案受限于双条带的问题,提出了一种针对多条带合并下的宽条带生成问题的高效宽条带生成方法.定义了多条带合并过程的2个关键算子,并将宽条带生成问题建模为组合优化问题,提出了优先寻找具有小的奇偶校验块传输成本的窄条带组合方案的高效宽条带生成方法 xStripeMerge.实验结果表明,与目前最优的存储扩容方法相比,xStripeMerge 可以减少 75%宽条带生成带宽.xStripeMerge 的时间和空间复杂度远优于扩展的双条带合并方法,xStripeMerge可以在更短的时间内获得与其性能相近的宽条带生成方案,并且xStripeMerge可以适用于大规模存储系统.
To address the issue of wide stripe generation in existing erasure coding storage systems,where storage scaling approaches resulted in a significant increase in wide stripe generation bandwidth and stripe merge scheme was con-strained by dual-stripes,an efficient wide stripe generation approach was proposed for the wide stripe generation problem under multi stripes merging.Two key operators for the multi-stripes merging progress were defined,and the wide stripe generation problem was modeled as a combinatorial optimization problem.The efficient wide stripe generation approach xStripeMerge was proposed that prioritize the search for narrow-stripes combining schemes with small parity block transmission costs.Experimental results show that xStripeMerge can reduce the wide stripe generation bandwidth by 75%compared to the advanced storage scaling method.The time and space complexity of xStripeMerge is much better than that of the extended dual-stripes merge approach.xStripeMerge can get the wide stripe generation scheme with similar performance in a shorter period of time and it is also suitable for large-scale storage systems.
郑美光;化韬斐;张心宇;胡志刚
中南大学计算机学院,湖南 长沙 410083中南大学计算机学院,湖南 长沙 410083中南大学计算机学院,湖南 长沙 410083中南大学计算机学院,湖南 长沙 410083
计算机与自动化
分布式存储纠删码宽条带条带合并奇偶块对齐
distributed storageerasure codingwide stripestripe mergeparity align
《通信学报》 2023 (11)
213-224,12
国家自然科学基金资助项目(No.62172442,No.62172451)湖南省自然科学基金青年基金资助项目(No.2020JJ5775)The National Natural Science Foundation of China(No.62172442,No.62172451),Youth Science Foundation of Natural Science Foundation of Hunan Province(No.2020JJ5775)
评论