计算机工程与应用2018,Vol.54Issue(8):7-13,35,8.DOI:10.3778/j.issn.1002-8331.1801-0246
基于Spark的FP-Growth伴随车辆发现与应用
Spark-based FP-Growth companion vehicles discovery and application
摘要
Abstract
With the extensive application of big data technology in traffic management,it has aroused the researchers' attention to detect the companion vehicles in the massive license plate data.However,most of the current methods are inefficient at large data volumes and remain in the theoretical research stage without being combined with practical appli-cations.This paper presents a novel approach to this application.Using Spark distributed parallel computing framework to improve the running speed,the load balancing principle is used to equalize the data,and then a companion vehicle discov-ery algorithm based on the improved FP-Growth is proposed.The confidence is used to post-process the results,excluding the random companion situation,improving the detection accuracy.The method is applied to Changsha Traffic Police Major Traffic Control Center System,in which massive license plate recognition data is stored in Hive database under Hadoop big data platform, visualized on Police PGIS(Police Geographic Information System).The experiment proves the efficiency and feasibility.关键词
伴随车辆/Spark计算框架/FP-Growth算法/随机伴随/片伴随Key words
companion vehicles/Spark computing framework/FP-Growth algorithm/random companion/slice companion分类
信息技术与安全科学引用本文复制引用
刘惠惠,张祖平,龙哲..基于Spark的FP-Growth伴随车辆发现与应用[J].计算机工程与应用,2018,54(8):7-13,35,8.基金项目
国家自然科学基金(No.61379109). (No.61379109)