计算机工程2017，Vol.43Issue(2)：63-67,5.DOI:10.3969/j.issn.1000-3428.2017.02.011
基于数据冗余的HBase合并机制研究
Research on HBase Compaction Mechanism Based on Data Redundancy
摘要
Abstract
In HBase,the operations are written to database in the form of appending data.HBase Compaction mechanisms occupy plenty of system resources,which affects read performance.To solve this problem,a mechanism based on data redundancy is proposed.By compacting the column files whose ratio of deleted data equals the threshold,the algorithm can reduce space occupation because it reduces the number of files while cleaning useless data.Experimental result indicates,compared with the original HBase Compaction mechanism,which only considers the size and number of files and time interval,the proposed Compaction mechanism can improve HBase system query efficiency and enhance HBase Major compaction capability.关键词
列式数据库/存储/HBase合并机制/CPU利用率/读性能Key words
column database/storage/HBase Compaction mechanism/CPU utilization rate/read performance分类
信息技术与安全科学引用本文复制引用
熊安萍,王运萍,邹洋..基于数据冗余的HBase合并机制研究[J].计算机工程,2017,43(2):63-67,5.基金项目
重庆市教委科学技术研究项目(KJ1400414) （KJ1400414）
重庆邮电大学博士启动基金(A2015-17) （A2015-17）
重庆邮电大学自然科学基金(A2011-29). （A2011-29）
