吉林大学学报(信息科学版)2017,Vol.35Issue(4):443-448,6.
基于优先级权重的Hadoop YARN调度算法
Hadoop YARN Scheduling Algorithm Based on Priority Weight
摘要
Abstract
In order to solve the problem that the existing scheduling task scheduler Hadoop can not depend on the degree of urgency task allocation of resources. We mainly research the resource scheduling mechanism in YARN ( Yet Another Resource Negotiator ) , improved the original capacity scheduler and proposes abased on priority weighted Hadoop YARN scheduling algorithm-weight scheduler based on priority. Firstly, setting queue priority for leaf queue, combining with the queue resource utilization and queue priority to select queue;Secondly, the initial of applications re-set its priorities size, by waitting time to judge whether to update the weight, according to the weight to sort the applications in the selected queue. The experiment shows that comparing with the existing scheduling algorithm, this algorithm has the advantage on the execution time by 141 s and waiting time by 34. 5% decreasing, ensure the user to perform a task relatively fair, improve the overall satisfaction of users.关键词
Hadoop YARN框架/资源调度器/优先级权重Key words
Hadoop yet another resource negotiator( YARN)/resource scheduler/priority weight分类
信息技术与安全科学引用本文复制引用
王荣丽,侯秀萍..基于优先级权重的Hadoop YARN调度算法[J].吉林大学学报(信息科学版),2017,35(4):443-448,6.基金项目
吉林省科技厅科技成果转化基金资助项目(20130303010GX) (20130303010GX)