高技术通讯2016，Vol.26Issue(4)：333-343,11.DOI:10.3772/j.issn.1002-0470.2016.04.002
HDAS：异构集群上Hadoop＋框架中的动态亲和性调度
HDAS:heterogeneous dynamic affinity scheduling in Hadoop+
摘要
Abstract
Aiming at the problem that the existing programming frameworks for heterogeneous clusters focus on utilizing heterogeneous resources in clusters while ignoring the delay of the working time caused by the contention of shared resources, this study proposed and implemented the heterogeneous dynamic affinity scheduling ( HDAS) algorithm based on the Hadoop+and the heterogeneity model , which dynamically calculates the real-time resource affinity of each available task according to the corresponding strategy of each resource and dispatches the most appropriate task launch in the system within a reasonable time to minimize the shared resource contention among simultaneously run -ning tasks to improve the overall throughput of the system .The experimental result showed an average 21.9x overall speedup of the HDAS compared to the Hadoop implementation on 25 hybrid workloads , while the original heteroge-neous model based scheduling strategy in Hadoop only obtained 17.9x speedup.And it showed obvious improve-ment on the hybrid workloads consisting of the tasks with more diverse resource requirements , and 21 of the 25 workloads presented the task delay of less than 1.06x in average.关键词
MapReduce/异构/Hadoop+/亲和性/调度Key words
MapReduce/heterogeneous/Hadoop+/affinity/scheduling引用本文复制引用
何文婷,崔慧敏,冯晓兵..HDAS：异构集群上Hadoop＋框架中的动态亲和性调度[J].高技术通讯,2016,26(4):333-343,11.基金项目
973计划（2011CB302504），863计划（2012AA010902，2015AA011505）和国家自然科学基金（61202055，61221062，61303053，61432016，61402445）资助项目。 （）
