计算机应用与软件2016,Vol.33Issue(11):117-121,168,6.DOI:10.3969/j.issn.1000-386x.2016.11.028
数据分配策略优化的全条带遥感影像流水线并行处理
PARALLEL PROCESSING OF LONG STRIP REMOTE SENSING IMAGE BASED ON PIPELINE WITH DATA DISTRIBUTION STRATEGY OPTIMISATION
摘要
Abstract
How to quickly process huge area-covering and high-resolution long strip remote sensing image is the problem of remote sensing application to be urgently resolved.Aiming at this problem,this paper proposes a parallel processing model for long strip image in distributed environment.The model adopts two-stage parallel approach with data parallel and pipeline parallel.First,we propose a new data distribution strategy by comprehensively considering the particularity of remote sensing data as well as its processing algorithm and the heterogeneous nature of distributed environment;then we introduce pipeline parallel technology to each computing node.Experimental results show that the model can flexibly carry out complicated data processing,it can effectively improve the efficiency of data processing as well.Under the condition of 7 computation nodes,it is able to acquire the speedup of 24.32 compared with traditional serial processing method.关键词
数据分配/全条带遥感影像/流水线/并行处理Key words
Data distribution/Long strip remote sensing image/Pipeline/Parallel processing分类
信息技术与安全科学引用本文复制引用
李亚林,张洪群,李山山..数据分配策略优化的全条带遥感影像流水线并行处理[J].计算机应用与软件,2016,33(11):117-121,168,6.基金项目
国家自然科学基金项目(41301383)。 ()