| 注册
首页|期刊导航|吉林大学学报(信息科学版)|基于优先级权重的Hadoop YARN调度算法

基于优先级权重的Hadoop YARN调度算法

王荣丽 侯秀萍

吉林大学学报(信息科学版)2017,Vol.35Issue(4):443-448,6.
吉林大学学报(信息科学版)2017,Vol.35Issue(4):443-448,6.

基于优先级权重的Hadoop YARN调度算法

Hadoop YARN Scheduling Algorithm Based on Priority Weight

王荣丽 1侯秀萍1

作者信息

  • 1. 长春工业大学 计算机科学与工程学院,长春 130012
  • 折叠

摘要

Abstract

In order to solve the problem that the existing scheduling task scheduler Hadoop can not depend on the degree of urgency task allocation of resources. We mainly research the resource scheduling mechanism in YARN ( Yet Another Resource Negotiator ) , improved the original capacity scheduler and proposes abased on priority weighted Hadoop YARN scheduling algorithm-weight scheduler based on priority. Firstly, setting queue priority for leaf queue, combining with the queue resource utilization and queue priority to select queue;Secondly, the initial of applications re-set its priorities size, by waitting time to judge whether to update the weight, according to the weight to sort the applications in the selected queue. The experiment shows that comparing with the existing scheduling algorithm, this algorithm has the advantage on the execution time by 141 s and waiting time by 34. 5% decreasing, ensure the user to perform a task relatively fair, improve the overall satisfaction of users.

关键词

Hadoop YARN框架/资源调度器/优先级权重

Key words

Hadoop yet another resource negotiator( YARN)/resource scheduler/priority weight

分类

信息技术与安全科学

引用本文复制引用

王荣丽,侯秀萍..基于优先级权重的Hadoop YARN调度算法[J].吉林大学学报(信息科学版),2017,35(4):443-448,6.

基金项目

吉林省科技厅科技成果转化基金资助项目(20130303010GX) (20130303010GX)

吉林大学学报(信息科学版)

OACSTPCD

1671-5896

访问量0
|
下载量0
段落导航相关论文