摘要
Abstract
In allusion to the rapid growth of Internet data and the rapid spread of public opinion information,a network public opinion analysis system based on big data is proposed. Four modules of data collection,preprocessing,analysis and re-port aggregation are included in the system to realize the automatic search and collection of the overall network public opinion in-formation,the formatted storage of large-scale public opinion data,and the analysis and statistical summary of public opinion in-formation. In the system,the Hadoop platform is used for data processing,the HDFS distributed file system is used to store pub-lic opinion data,and the MapReduce technology is used to complete public opinion analysis and report. The simulation results show that the system can help analyze network public opinion timely and accurately,and meet the requirement of network pub-lic opinion analysis well.关键词
大数据/网络舆情/舆情分析/Hadoop/HDFS/MapReduceKey words
big data/network public opinion/public opinion analysis/Hadoop/HDFS/MapReduce分类
信息技术与安全科学
