重庆邮电大学学报（自然科学版）Issue(1)：125-130,6.DOI:10.3979/j.issn.1673-825X.2016.01.019
基于 HBase 的小文件高效存储方法
Efficient storage method of small-file based on HBase
熊安萍 1熊风波1
作者信息
- 1. 重庆邮电大学 计算机科学与技术学院，重庆 400065
- 折叠
摘要
Abstract
In recent years,related systems have been widely used based on Hadoop.Particularly,Hadoop distributed file system(HDFS)is responsible for handling big data files by distributed way of working.However,in terms of HDFS,the problem of small-file storage in Big data is restricted by the ability of HDFS to work effectively.In the view of the lower effi-ciency of reading and writing for small-file in big data,this paper proposes an efficient storage method of Small-File based on HBase.The storage advantage of HBase is used in this paper;small files are stored in HBase directly;it reduces the NameNode load and provides the transparent access interface to the upper-level application system.The experimental result shows that the method implements efficient storage for a lot of small files,in addition,the efficiency performance of reading and writing for small files in HDFS is improved by this method.关键词
Hadoop 分布式文件系统(HDFS)/海量数据/HBase/小文件存储/读写性能Key words
Hadoop distributed file system(HDFS)/big data/HBase/small-file storage/performance of reading and writing分类
信息技术与安全科学引用本文复制引用
熊安萍,熊风波..基于 HBase 的小文件高效存储方法[J].重庆邮电大学学报（自然科学版）,2016,(1):125-130,6.
