计算机技术与发展2017，Vol.27Issue(6)：146-150,155,6.DOI:10.3969/j.issn.1673-629X.2017.06.030
Redis分布式缓存技术在Hadoop平台上的应用
Application of Redis Distributed Caching Technology in Hadoop Framework
摘要
Abstract
In the scene of large scale data analysis with Hadoop,rapid accessing to shared resources is a typical problem that has not been satisfactorily solved so far.Examples of such problem include page rank algorithm,minimum error-rate training algorithm,expectation maximization algorithm and so on.Although solutions to such problems have existed,the actual effect is not satisfactory.Thus,an open-source distributed in-memory database,Redis,has been explored to provide high-throughput access to shared resources in Hadoop.Experimental results illustrate that Redis has the characteristic of linear increase in throughput with respect to cluster size so that it can provide a general-purpose solution for rapid accessing to shared resources in Hadoop cluster,and that it has provided an easier implementation of algorithms that has not been satisfactorily solved at large scale with Hadoop.Meanwhile,the use of Redis,the commercial-grade open-source tool,implies that the proposed solution has been easily adapted in both research and production environments.关键词
Redis/分布式缓存/Hadoop/MapReduceKey words
Redis/distributed caching/Hadoop/MapReduce分类
信息技术与安全科学引用本文复制引用
姚经纬,杨福军..Redis分布式缓存技术在Hadoop平台上的应用[J].计算机技术与发展,2017,27(6):146-150,155,6.基金项目
工信部高技术船舶项目(2016[26]) （2016[26]）
