计算机技术与发展2017，Vol.27Issue(11)：171-175,5.DOI:10.3969/j.issn.1673-629X.2017.11.037
基于Hadoop的固网宽带终端识别技术研究和实现
Research and Implementation of Terminal Identification Technology of Fixed-line Broadband Based on Hadoop
摘要
Abstract
With the coming of the era of big data,big data is more and more widely applied in various industries,which is also done in op-erators industry,but many technical problems are found simultaneously,of which family portraits of shaping is a core for operators of large data. How to extract and identify the terminal type of fixed-line broadband is a problem needed to be solved. Unlike mobile net-work,fixed-line broadband don' t take any accurate terminal information due to lack of signaling channel,so it is hard to conduct termi-nal type identification in fixed-line. The traditional method adopts UA fields of HTTP GET message parsing and matching for identifica-tion,but it is low in identification accuracy because of UA non-standardized and the large amounts of terminal number and varieties. Based on the Hadoop framework,the UDF of Hive is used,and combined with the distributed crawler for obtainment of terminal library, the user terminal information online is identified more quickly and accurately. According to the experiment,the accuracy of terminal iden-tification can reach above 92%,a substantial increase compared with the traditional method.关键词
终端识别/Hadoop/UserDefinedFunction(UDF)/分布式爬虫/固网宽带/大数据运营Key words
terminal identification/Hadoop/User Defined Function ( UDF)/distributed crawler/fixed-line broadband/big data operations分类
信息技术与安全科学引用本文复制引用
范孟可,王攀..基于Hadoop的固网宽带终端识别技术研究和实现[J].计算机技术与发展,2017,27(11):171-175,5.基金项目
2015江苏省产学研前瞻性联合研究项目(BY2015011-02) （BY2015011-02）
