计算机工程与应用2017,Vol.53Issue(5):73-80,8.DOI:10.3778/j.issn.1002-8331.1507-0170
异构计算平台上列存储系统的并行连接优化策略
Optimizing parallel join of column-stores on heterogeneous computing platform
摘要
Abstract
GPU and integrated CPU-GPU architecture has powerful parallel processing capability and programmable pipeline, which gradually becomes a hot area of database researches. In order to fully explore the parallel abilities of het-erogeneous platform, enhance the performance of the column-storage database query, in this paper, it takes full account of differences of system architecture based on heterogeneous platforms, firstly proposes the improved multidimensional data classification method of data partition strategy ICMD based on improving the multi-dimensional data partitioning method (CMD), using stream processor to process sub-space join operation in parallel. Secondly, through the implementation of query dynamic load using task allocation model evaluation, it makes the query execution in parallel between multi-core CPU, GPU and other accelerator components. At the same time, it uses on-chip global synchronization and efficient imple-mentation, local memory reuse optimization ICMD connection algorithm. Using SSB benchmark test, the experimental re-sults show that based on the platform of Intel HD Graphics 4600, ICMD connection query receives 1.35 speedup com-pared to the CPU version and receives 18%performance improvement compared with Ocelot of GPU query engine.关键词
多核中央处理器-图形处理器(CPU-GPU)/流处理器/异构编程/列存储/改进协调模块分布(ICMD)/任务动态评估分配Key words
multi-core Central Processing Unit-Graphics Processing Unit(CPU-GPU)/stream processor/heterogeneous program/column storage/Improved Coordinate Module Distribution(ICMD)/dynamic evaluation of task allocation分类
信息技术与安全科学引用本文复制引用
丁祥武,陈金鑫,王梅..异构计算平台上列存储系统的并行连接优化策略[J].计算机工程与应用,2017,53(5):73-80,8.基金项目
国家自然科学基金(No.61103046) (No.61103046)
上海市自然科学基金(No.11ZR1401200). (No.11ZR1401200)