计算机工程与科学2018，Vol.40Issue(2)：210-217,8.DOI:10.3969/j.issn.1007-130X.2018.02.003
基于Spark的并行遗传算法求解多峰函数极值
A Spark based parallel genetic algorithm solving multimodal function extremums
摘要
Abstract
The Genetic Algorithm (GA) needs many computation iterations in solving multimodal function extremums,so its running efficiency is too low when dealing with large-scale data,which greatly limits its practical application.The classical parallel platform Hadoop can improve the GA running efficiency to some extent,while the state-of-the-art parallel platform Spark can release much more parallelism of GA by realizing parallel crossover,mutation and other operations on each computing node.For the convenience of comparison,the GA solving multimodal function extremums are designed and implemented on single node,Hadoop and Spark,respectively.Experimental results show that,compared with single node platform and Hadoop platform,the Spark based implementation not only significantly reduces the running time but also effectively avoids the problem of premature convergence because of its powerful randomness,while dealing with large-scale samples.关键词
遗传算法/多峰函数/极值/并行计算/Spark/HadoopKey words
genetic algorithm/multimodal function/extremum/parallel computing/Spark/Hadoop分类
信息技术与安全科学引用本文复制引用
刘鹏,叶帅,孟磊,王灿..基于Spark的并行遗传算法求解多峰函数极值[J].计算机工程与科学,2018,40(2):210-217,8.基金项目
国家自然科学基金(61471361,41302203) （61471361,41302203）
