计算机应用研究2017，Vol.34Issue(10)：3139-3143,5.DOI:10.3969/j.issn.1001-3695.2017.10.057
基于任务进度感知的异构Hadoop云平台任务调度方案
Task scheduling scheme in heterogeneous Hadoop cloud platform based on task progress aware
摘要
Abstract
For the issue that the task scheduling problem in heterogeneous Hadoop cloud computing platform,this paper analyzed the defects of speculative execution scheduling and LATE scheduling scheme,and proposed a task scheduling scheme based on task progress aware.Firstly,it estimated the approximate task completion time (ATE) according to the task progress on computing nodes,so as to determine the straggler task.Then,it divided the node into slow and fast nodes by the threshold value,which was 25％ of average task progress.When the straggler backup task reached a certain threshold,it would be assigned to the fast node priority.The experimental results show that the proposed scheme can reasonably schedule tasks for heterogeneous Hadoop platforms,and effectively reduces the task completion time,response delay,and improves the throughput of the platform.关键词
Hadoop云平台/任务调度/任务进度感知/掉队者任务/节点分类Key words
Hadoop cloud platform/task scheduling/task progress aware/straggler task/node classification分类
信息技术与安全科学引用本文复制引用
刘莹,罗兴宇,王宁,罗强..基于任务进度感知的异构Hadoop云平台任务调度方案[J].计算机应用研究,2017,34(10):3139-3143,5.基金项目
重庆市教委科学技术研究项目(KJ1502003) （KJ1502003）
重庆市本科高校“三特行动计划”特殊专业建设项目(渝教高(2013)49号) （渝教高(2013）
