计算机应用与软件Issue(3)：243-246,278,5.DOI:10.3969/j.issn.1000-386x.2015.03.058
基于 MapReduce 的预处理高效 Skyline 算法
EFFICIENT PRE-PROCESSED SKYLINE ALGORITHM BASED ON MAPREDUCE
摘要
Abstract
Existing MapReduce-based algorithms can not process Skyline query efficiently on big data.In view of this,we propose an efficient pre-processed Skyline query algorithm MRFS (MapReduce-based filter Skyline).It pre-processes big datasets and extracts small point-sets with stronger control abilities to form comparison point-set.Before the MRFS commence,the comparison point-set is used to filter the raw datasets to eliminate a great part of data objects which can not become Skyline outcome set;Then,for the filtered datasets,partial Skyline sets will be parallelly calculated in Map stage,and at last they are merged to a Reduce task to get final Skyline outcome set. Systematic experiments with different data distribution are conducted,results demonstrate that our algorithm improves the time efficiency by 20% to 30% than the existing algorithms.关键词
MapReduce/大数据/SkylineKey words
MapReduce/Big data/Skyline分类
信息技术与安全科学引用本文复制引用
李文俊,张大方,李玮..基于 MapReduce 的预处理高效 Skyline 算法[J].计算机应用与软件,2015,(3):243-246,278,5.基金项目
国家自然科学基金项目（61173167）；国家重点基础研究发展计划项目（2012CB315805）；湖南省科技计划项目 （）
