计算机技术与发展2018,Vol.28Issue(2):9-13,5.DOI:10.3969/j.issn.1673-629X.2018.02.003
基于Hive的智慧城市数据处理技术研究与实现
Research and Implementation of Data Processing Technology of Intelligent City Based on Hive
摘要
Abstract
It must be solvable for effective acquisition,reasonable storage,efficient and accurate analysis of the large amounts of data from in-telligent city system,and then providing the reasonable support for decision-making in the construction of intelligent city.For this,combined with currently mainstream data analysis technologies,we propose a data analysis solution of Kettle+Hive+Tableau for intelligent park on the basis of fully understanding the functional requirements and performance requirements of the intelligent park data analysis system.The system is of better availability,stability and efficiency as well as excellent scalability and portability,which is not only suitable for the data analysis of wisdom park,but also widely applied to the analysis of data from intelligent information system. In addition,it has high universality. Through the application of ETL tools and data visualization tools,it minimizes the writing code in the development of data analysis system, which can be applied to most of the information system with data analysis needs and lots of data.关键词
智慧城市/Hive/数据采集/数据可视化分析Key words
smart city/Hive/data acquisition/data visualization analysis分类
信息技术与安全科学引用本文复制引用
艾丽蓉,刘云峰..基于Hive的智慧城市数据处理技术研究与实现[J].计算机技术与发展,2018,28(2):9-13,5.基金项目
国家自然科学基金(61502371) (61502371)