计算机应用与软件2016,Vol.33Issue(3):62-66,5.DOI:10.3969/j.issn.1000-386x.2016.03.013
基于 HDFS 的创新知识云平台存储架构的研究与设计
RESEARCH AND DESIGN OF HDFS-BASED STORAGE ARCHITECTURE FOR INNOVATIVE KNOWLEDGE CLOUD PLATFORM
马建红 1霍振奇1
作者信息
- 1. 河北工业大学计算机科学与软件学院 天津 300401
- 折叠
摘要
Abstract
Because current storage structure cannot meet the storage and service demands brought by massive innovative knowledge,we presented an improved HDFS distributed storage system and applied it to the innovative knowledge cloud platform.First,we introduced the package file and distributed indexing service,thus improved the efficiency of HDFS small files storage problem.Then by optimising the naming space backup and failure recovery services in HDFS we achieved high availability architecture of HDFS with stronger availability and higher resource utilisation.By designing and implementation of the system we proved that the optimisation work greatly reduced the memory pressure of naming node and enhanced the availability of cluster,and the improved HDFS storage system could meet the storage needs of innovative knowledge cloud platform.关键词
创新知识/HDFS/小文件存储/单点故障Key words
Innovative knowledge/Hadoop Distributed File/System (HDFS) Small files storage/Single point of failure分类
计算机与自动化引用本文复制引用
马建红,霍振奇..基于 HDFS 的创新知识云平台存储架构的研究与设计[J].计算机应用与软件,2016,33(3):62-66,5.