计算机技术与发展Issue(7)：96-99,106,5.DOI:10.3969/j.issn.1673-629X.2015.07.021
基于应用程序的MapReduce性能优化
Performance Optimization of MapReduce Based on Applications
摘要
Abstract
For the problem of poor execution efficiency under MapReduce framework,multiple solutions on performance optimization of MapReduce is studied. Firstly,the cloud computing definition and its characteristics,Hadoop composition are described in detail,then the framework of MapReduce and application development under the framework is introduced in this paper. Three main directions of perform-ance optimization for MapReduce are also discussed,including the system optimization realized,parameters optimized and application op-timization. Furthermore,multiple solutions are put forward from the application viewpoint,including in-Map Reduce optimization algo-rithm,script language/compile language contrast experiment,tuning for small files. Lastly,analyze optimization technique and experimen-tal data. The experimental results show that the optimized application is an effective means to improve the performance of MapReduce.关键词
MapReduce/应用程序/性能优化/in-Map Reduce/小文件优化Key words
MapReduce/application/performance optimization/in-Map Reduce/tuning for small files分类
信息技术与安全科学引用本文复制引用
高莉莎,刘正涛,应毅..基于应用程序的MapReduce性能优化[J].计算机技术与发展,2015,(7):96-99,106,5.基金项目
江苏省卓越工程师(软件类)计划试点专业(苏教高函[2012]17号) （软件类）
江苏省高等学校软件服务外包类专业嵌入式人才培养项目(苏教高函[2014]14号) （苏教高函[2014]14号）
江苏省电力公司科技项目(J2014057) （J2014057）
三江学院本科工程二期项目(J14021) （J14021）
