高技术通讯2018,Vol.28Issue(1):1-7,7.DOI:10.3772/j.issn.1002-0470.2018.01.001
NJ-GPCA:一种面向并行空间计算的高效数据访存策略
NJ-GPCA: a fast data I/O strategy for parallel spatial computing
摘要
Abstract
A parallel computing strategy named no join-general parallel computing architecture(NJ-GPCA)is proposed to solve the spatial overlay analyzing technique's drawbacks of poor I/O performance and low parallel task schedu-ling efficiency.Firstly,the strategy puts the vector spatial data into the database of Redis with the new structure, and then cuts down the processes wait time and improves the efficiency of I /O by data pre-processing and task dis-tributing.Finally,the strategy uses a new task allocation and task scheduling to avoid result collection,which re-duces the time complexity of the algorithm's collection stage to O(n)from O(nlogn).The experimental result shows that the strategy can reduce the I/O time by at least 75%and significantly improve the efficiency of the algo-rithm.关键词
空间叠加分析/I/O/并行计算/任务调度Key words
spatial overlay analysis/I/O/parallel computing/task scheduling引用本文复制引用
姚晓,邱强,肖茁建,方金云..NJ-GPCA:一种面向并行空间计算的高效数据访存策略[J].高技术通讯,2018,28(1):1-7,7.基金项目
国家重点研发计划(2016YFB0502300,2016YFB0502302)资助项目. (2016YFB0502300,2016YFB0502302)