华东交通大学学报Issue(5):37-41,91,6.
基于Hadoop的电网监控信息流分布式处理研究
Distributed Processing of Grid Monitoring Information Flow Based on Hadoop
摘要
Abstract
In order to solve problems of large data sets access for monitoring information flow in smart grid dis-patching system,this paper proposes a distributed cluster processing method based on Hadoop cloud computa-tion framework for monitoring information flow. By analyzing information flow characteristics of power grid monitoring system,the three kinds of key processing stream were extracted;By comprehensively using distrib-uted file system HDFS and the parallel programming model Map/Reduce,the cluster distributed information processing platform was established,and information efficient parallel processing was achieved. Taking power grid dispatching measurement logging data set as an example,the test results show that the new method process-ing efficiency is improved 1.4 times compared with traditional client/server database method,and is related to cluster node scale,which can avoid response delay problem of large data sets information processing.关键词
智能电网/信息流/Hadoop云计算/映射聚合/并行处理Key words
smart grid/information flow/Hadoop cloud computation/Map/Reduce/parallel processing分类
信息技术与安全科学引用本文复制引用
屈志坚,郭亮,陈阁..基于Hadoop的电网监控信息流分布式处理研究[J].华东交通大学学报,2013,(5):37-41,91,6.基金项目
国家自然科学基金项目(51267005);江西省教育厅科技研究项目 ()