现代电子技术2016，Vol.39Issue(6)：25-29,5.DOI:10.16652/j.issn.1004-373x.2016.06.007
Hadoop集群作业调度算法优化技术研究
Research on optimization technology of Hadoop cluster job scheduling algorithm
摘要
Abstract
Conception of studying Hadoop cluster job scheduling algorithm is composed in allusion to extensive application of the current cloud computing technology. According to the deep study of Hadoop Map Reduce V2(Yarn)in the new edition Hadoop,a complete contrast experiment was designed,and the advantages and disadvantages of all kinds of job scheduling algo⁃rithms were tested. The comparison was carefully made by applying the different job scheduling algorithms on the same job. The differences and characters in calculation ability,operation time,and resource occupation of all the job scheduling algorithms and calculation frameworks were obtained. The experimental results show that the fair scheduling algorithm and the calculation capacity scheduling algorithm are more flexible and more efficient than the traditional FIFO scheduling algorithm.关键词
云计算/Hadoop/HDFS/作业调度/集群Key words
cloud computing/Hadoop/HDFS/job scheduling/cluster分类
信息技术与安全科学引用本文复制引用
单冬红,郭静博,赵伟艇..Hadoop集群作业调度算法优化技术研究[J].现代电子技术,2016,39(6):25-29,5.基金项目
河南省科技厅计划项目基于决策树和遗传神经网络的房地产预警系统研究（132102310516）；平顶山学院青年基金项目基于神经网络的软件故障定位研究 （）
