计算机工程Issue(10)：10-13,4.DOI:10.3969/j.issn.1000-3428.2013.10.003
一种基于云计算的并行流生成方法
A Parallel Flow Generating Approach Based on Cloud Computing
摘要
Abstract
In high speed networks, the forwarding performance of a network device which captures flows is inevitably degraded. A parallel flow generating approach based on small size cloud computing platform outside of network device is proposed. A small size cloud can be deployed near the selected network device being monitored, and packet traffic through the network device is copied into the cloud. Then flow records can be extracted fast from the large volume packet traffic by the parallel Map-Reduce framework of cloud. A parallel flow extraction algorithm based on Map-Reduce framework is proposed. In addition, cloud scale is flexible to expand, and by configuring proper cloud workers, this approach can be adopted to analyze network traffic in arbitrary size. Real network packet traffic is used to verify the performance of the parallel flow generating approach. Analysis results show that in clouds consisting of 3, 5 or 7 worker nodes, 15 160 052 flows are recognized from more than 40 GB text packet data, and comparing against sequentially processing method, the consumed time are reduced by more than 85%, 90%and 94%, respectively.关键词
网络流量分析/并行处理/Map-Reduce框架/Hadoop平台Key words
network traffic analysis/parallel processing/Map-Reduce framework/Hadoop platform分类
信息技术与安全科学引用本文复制引用
孙韩林..一种基于云计算的并行流生成方法[J].计算机工程,2013,(10):10-13,4.基金项目
陕西省教育厅自然科学基金资助项目(11JK1018) （11JK1018）
