计算机技术与发展Issue(4)：48-52,5.DOI:10.3969/j.issn.1673-629X.2015.04.012
基于MapReduce数据密集型负载调度策略研究
Research on Scheduling Strategy of Data Intensive Workloads Based on MapReduce
摘要
Abstract
Aiming at processing of large-scale data set in cloud computing environment,MapReduce has become a powerful processing platform. In this paper,propose a resource evaluation and dynamic resource reconfiguration and scheduling algorithm based on virtualiza-tion platform dynamic resource reconfiguration. It can dynamically evaluate the required number of Map/Reduce slots for every job to meet completion time guarantee and adjust the CPU resources while not violating completion time goals of the users by dynamically in-creasing or decreasing individual VMs to maximize data locality and also to maximize the use of resources within the system among the active jobs. Simulation results show that the algorithm can improve the throughput of MapReduce jobs on the cluster significantly.关键词
云计算/数据本地性/MapReduce/HadoopKey words
cloud computing/data locality/MapReduce/Hadoop分类
信息技术与安全科学引用本文复制引用
秦军,童毅,戴新华,林巧民..基于MapReduce数据密集型负载调度策略研究[J].计算机技术与发展,2015,(4):48-52,5.基金项目
江苏省自然科学基金项目(BK20130882) （BK20130882）
