论文基于主题相关度的地理信息Web服务爬虫研究 >>GIS>>中心>>GIS空间站

基于主题相关度的地理信息Web服务爬虫研究

摘要

针对通用搜索引擎对于地理信息Web服务检索存在的不足,提出了一种基于主题相关度的服务爬虫方法,利用向量空间模型表示主题特征,通过引入特征值权重的计算方法分析页面内容与主题的相关度,过滤与主题无关的页面;并利用改进的PageRank算法从URL和锚文本两方面分析链接的重要性,优化爬取队列。实验表明,该方法在服务检索效率和抓取能力上都取得了良好的效果。
According to the defects of Common Search Engine on retrieving Geographic Information Web Services(GIServices),a web service crawler based on topic-relevance was designed and proposed in this paper.Firstly,this paper analyzed and defined the topic features of GIServices by utilizing Vector Space Model(VSM),which could facilitate the representation and calculation of topic features.Secondly,based on the introduction of calculation of topic weight,the paper presented an algorithm to analyze the si...

下载地址

https://www.shaofei.name- GIS空间站