计算机工程与应用2017，Vol.53Issue(9)：80-84,5.DOI:10.3778/j.issn.1002-8331.1601-0040
基于HBase的气象结构化数据查询优化
Optimization of meteorological structured data based on Hbase
摘要
Abstract
Massive meteorological observations data is the key of the improvement of public weather services'refinement, precision and personalized level. The increased meteorological data can reach to 1 TB every day. The timeless require-ments of large scale meteorological data for its storage, retrieval, transfer and share is a challenge to traditional meteoro-logical information system while based on IOE(IBM, Oracle and EMC)framework. Based on HBase, this paper proposes a structural query optimization using index, named as Hbase4M(HBase for Meteorology). Firstly, the table structure is designed according to the HBase storage property. Secondly, the secondary indexes are established and maintained by HBase coprocessors. It will convert the field query to rowkey search in index table. It also facilitates HBase4M directly to inherit HBase's scalability and low latency and support the flexibility of structure meteorological data query. Experimental results show that the performance of HBase4M can satisfy the demands of meteorological business services.关键词
气象数据/HBase/辅助索引/分布式存储Key words
meteorological data/HBase/secondary index/distributed storage分类
信息技术与安全科学引用本文复制引用
徐熙超,杨铮,马廷淮..基于HBase的气象结构化数据查询优化[J].计算机工程与应用,2017,53(9):80-84,5.基金项目
科技部公益性行业(气象)科研专项(No.GYHY201506080). （气象）
