计算机工程2017,Vol.43Issue(8):69-73,5.DOI:10.3969/j.issn.1000-3428.2017.08.012
一种面向高性能计算的分布式对象存储系统
An HPC-oriented Distributed Object Storage System
摘要
Abstract
The existing distributed file storage system has problems like inefficient data organization and redundant access semantics,etc.,which severely limit the performance of High Performance Computing(HPC)storage system.Therefore,this paper presents HPC-oriented distributed Object Storage System(COSS)based on the idea of object storage.It separates the data access and data management to achieve more streamlined and efficient access semantics,uses distributed global object data organization method and designs memory-based metadata management method to improve system performance.Experimental results show that,under large scale concurrent access,COSS can improve read and write aggregated bandwidth by 22.5%and 50.4%respectively compared with Lustre system.The performance of file creation and file deletion of COSS is respectively 2.15 times and 5.13 times of Lustre system.Meanwhile,COSS provides quasi-linear data read/write performance and metadata management performance.It also has excellent scalability.关键词
高性能计算/对象存储/存储语义/元数据管理/可扩展性Key words
High Performance Computing(HPC)/object storage/storage semantics/metadata management/scalability分类
信息技术与安全科学引用本文复制引用
陈曦,朱建涛,何晓斌..一种面向高性能计算的分布式对象存储系统[J].计算机工程,2017,43(8):69-73,5.基金项目
国家高技术研究发展计划项目(2013AA013203,2013AA01A210). (2013AA013203,2013AA01A210)