计算机工程2017，Vol.43Issue(1)：37-42,6.DOI:10.3969/j.issn.1000-3428.2017.01.007
基于Storm拓扑结构热边的调度算法
Scheduling Algorithm Based on Storm Topology Hot-edge
摘要
Abstract
Storm is an open source distributed real-time computation system.It takes round-robin scheduling algorithm to achieve task distribution balancing,but the Storm default scheduling algorithm disregards inter-node network communication overhead,which may cause the problem of high processing latency and low throughput.To solve these problems,the concept of Storm topology hot-edge is proposed.The proposed algorithm can reduce the number of tuple which is transmitted through network by scheduling the hot-edge connected source exeactor and target executor to the same cluster node,which in turn promotes calculation performance of Storm cluster.Experimental results show that the proposed scheduling algorithm can reduce the Storm processing latency and cluster inter-node traffic,and improve system throughput,which is conducive to cluster load balancing.关键词
实时计算/拓扑结构热边/调度算法/负载均衡/网络通信Key words
real-time computing/topology hot-edge/scheduling algorithm/load balancing/network communication分类
信息技术与安全科学引用本文复制引用
熊安萍,王贤稳,邹洋..基于Storm拓扑结构热边的调度算法[J].计算机工程,2017,43(1):37-42,6.基金项目
重庆市教委科学技术研究项目(KJ1400414) （KJ1400414）
重庆邮电大学博士启动基金(A2015-17) （A2015-17）
重庆邮电大学自然科学基金(A2011-29). （A2011-29）
