计算机工程与应用Issue(2):226-230,5.DOI:10.3778/j.issn.1002-8331.1307-0161
基于Hadoop Streaming的Last比对软件并行化的研究与实现
Parallel implementation for Last based on Hadoop Streaming
摘要
Abstract
With the arrival of the next generation sequencing technology, stand-alone version of the Last alignment soft-ware is not good enough for massive data processing while Hadoop Streaming technology can solve the problem by rapidly deploying Last software to the distributed cluster. It will be ensured to a balanced and effective data segmentation as well as control of the parallel granularity by the NFS-based customizing segmentation of data set and Partitioner based distribu-tion of tasks. Experimental results show that this method can guarantee the same results with the stand-alone operation, effectively reduce the running time with a relatively high speed.关键词
hadoop streaming/软件并行化/last比对软件Key words
hadoop streaming/software parallelization/last alignment software分类
信息技术与安全科学引用本文复制引用
董本志,李文浩,景维鹏..基于Hadoop Streaming的Last比对软件并行化的研究与实现[J].计算机工程与应用,2014,(2):226-230,5.基金项目
中央高校基本科研业务费专项资金项目(No.DL13CB05);哈尔滨市科技创新人才研究专项(No.2013RFXXJ089);哈尔滨市应用技术研究与开发项目(No.2013AE1CE007)。 ()