国防科技大学学报2017，Vol.39Issue(6)：51-58,8.DOI:10.11887/j.cn.201706009
分布式计算环境下的栅格数据存储策略
Storage strategy of raster data under the distributed computing environment
摘要
Abstract
Traditional storage strategy of raster data cannot meet the demands of coarse-grained data processing under the distributed computing environment and has low efficiency when dealing with calculations for gigantic raster data.A storage strategy of raster tile data was presented on the basis of the storage characteristics of distributed file system.It also took the calculation characteristics of spatial analysis operators of map algebra into consideration,which uses raster tile as processing unit during map and reduce stage.The storage strategy was implemented by the following steps.Firstly raster data were divided into raster tiles.Then these tiles were compressed and organized by a special sequence in order to be transferred to Hadoop distributed file system.Finally input and output file interfaces were re-implemented to meet the data access requirements of map and reduce stage.The strategy was tested and verified by the distributed calculation process of local map algebra operators.Theoretical analysis and experimental results show that this strategy can significantly improve the processing speed of space analysis operators.关键词
分布式计算/栅格数据/存储策略/地图代数Key words
distributed computing/raster data/storage strategy/map algebra分类
信息技术与安全科学引用本文复制引用
张剑波,夏灯城,赵加奥,李谢清,崔永键,袁国斌..分布式计算环境下的栅格数据存储策略[J].国防科技大学学报,2017,39(6):51-58,8.基金项目
国家自然科学基金资助项目(41001225,41501584) （41001225,41501584）
