计算机应用研究2009,Vol.26Issue(8):2931-2933,3.DOI:10.3969/j.issn.1001-3695.2009.08.038
面向主题网络爬行的智能隧道穿越算法研究
Focused crawling oriented intelligent tunneling algorithm research
黄莉 1王成良 2杨铮1
作者信息
- 1. 重庆大学,计算机学院,重庆,400030
- 2. 重庆大学,软件学院,重庆,400030
- 折叠
摘要
Abstract
This paper proposed a new intelligent tunneling algorithm based on deep research on traditional focused crawling strategy. This algorithm combined with tunneling technology and fast online Q(λ) learning and led focused crawler to go through from low relevant areas to high ones with the smallest cost by online learning and experience accumulation. In the simulation experiment, compared intelligent tunneling algorithm with normal tunneling, the result shows that the intelligent tunneling algorithm has reduced the time space complexity and improves performance and increases efficiency of focused crawler.关键词
主题网络爬虫/爬行策略/隧道/在线学习/马尔可夫Key words
focused crawler/focused crawling strategy/tunneling/online learning/Markov分类
信息技术与安全科学引用本文复制引用
黄莉,王成良,杨铮..面向主题网络爬行的智能隧道穿越算法研究[J].计算机应用研究,2009,26(8):2931-2933,3.