计算机应用研究2016,Vol.33Issue(10):3109-3113,5.DOI:10.3969/j.issn.1001-3695.2016.10.052
基于SD N的MapRed uce带宽优化设计
Optimization design of MapReduce based on SDN
摘要
Abstract
In practical Hadoop systems,how to make the job completion time shorter is the NP complete problem.The main reason for this problem is the long time in the process of massive data transmission from the Map node to the Reduce node, which is caused by the network congestion.Software defined networking completely strips out the control plane from switch and migrate it into the controller,enabling the switches to handle the data in network and the controllers to know global network, which provides the possibility of the MapReduce network optimization in the OpenFlow network structure.The paper proposed a method on merging the Map intermediate data on the OpenFlow switch to reduce the time for data transmission through the flexible control on network of SDN.关键词
软件定义网络/MapReduce/带宽优化/中间值合并Key words
software defined network(SDN)/MapReduce/bandwidth optimization/merging the map intermediate data分类
信息技术与安全科学引用本文复制引用
杨军,吕璐,徐冠,王曼,戴彬..基于SD N的MapRed uce带宽优化设计[J].计算机应用研究,2016,33(10):3109-3113,5.基金项目
国家科技支撑计划资助项目(2012BAH93F01);华中科技大学自主创新研究基金资助项目(2015MS037);国家自然科学基金资助项目 ()