计算机与现代化Issue(4):122-126,5.DOI:10.3969/j.issn.1006-2475.2017.04.025
基于隐马尔科夫模型的网络爬虫检测算法仿真
Simulation of Web Crawler Detection Algorithm Based on Hidden Markov Model
琚兴空1
作者信息
- 1. 武汉邮电科学研究院烽火科技学院,湖北 武汉 430074
- 折叠
摘要
Abstract
In the construction and maintenance process of the website, in order to improve server efficiency, strengthen security and confidentiality, developers need to distinguish between human users and Web crawlers.However, some inappropriate or malicious designs make it difficult to detect crawlers.These crawlers not only increase the burden on the site, but also endanger the security of network.In order to solve the problem that it is difficult to detect crawlers, a detection algorithm based on behavior pattern is proposed, which uses hidden Markov model to describe the behavior patterns of different clients and uses Matlab simulation to achieve a highly accurate detection result.The simulation results show that the detection technology of hidden Markov model can detect Web crawler with high accuracy and low error rate.关键词
网络爬虫检测/行为模式/隐马尔科夫模型/网络安全Key words
Web crawler detection/behavior pattern/hidden Markov model/network security分类
信息技术与安全科学引用本文复制引用
琚兴空..基于隐马尔科夫模型的网络爬虫检测算法仿真[J].计算机与现代化,2017,(4):122-126,5.