计算机应用与软件2017，Vol.34Issue(6)：37-42,6.DOI:10.3969/j.issn.1000-386x.2017.06.008
基于HBASE的时空大数据关联查询优化
OPTIMIZATION OF SPATIAL AND TEMPORAL BIG DATA ASSOCIATION QUERY BASED ON HBASE
摘要
Abstract
With the rapid development of digital acquisition and storage technology, video surveillance system has been rapidly popularized, which brings a lot of monitoring video data.Different from the text data, the monitoring data has the characteristics of time and space, and how to carry out efficient query under the large-scale and dynamic growth of data becomes a concern of many spatial and temporal data applications.To meet the requirement of space-time joint query for efficient monitoring of large video data in cloud storage architecture, in this paper, we make full use of the relationship between the temporal and spatial eigenvalues and the attribute eigenvalues in the application and the excellent performance of the HBase database in the massive query, propose HBase Bloomfilter`s multi-filtering mechanism of large data in space and time, and make use of the dependency and association between the eigenvalues of video files to arrange rowkey index keys in an innovative manner.On this basis, two kinds of spatiotemporal correlation query algorithms are designed.Finally, the feasibility, flexibility and efficiency of the algorithm are proved by experiments.It is useful for other large data association queries.关键词
云存储/大数据/关联查询/时空特征Key words
Cloud storage/Big data/Associated query/Spatial and temporal characteristics分类
信息技术与安全科学引用本文复制引用
徐爱萍,王波,张煦..基于HBASE的时空大数据关联查询优化[J].计算机应用与软件,2017,34(6):37-42,6.基金项目
国家水体污染控制与治理科技重大专项(2013ZX07503-001) （2013ZX07503-001）
湖北省重大科技创新计划项目(2013AAA020). （2013AAA020）
