A web partition algorithm based on support vector machine

作者:Zhang Weizhe*; Zhang Hongli; Zhang Hong; Chen Gui; Wei Yifan
来源:Przeglad Elektrotechniczny, 2012, 88(1B): 31-33.

摘要

In order to solve the problem of network traffic partition of crawler nodes and website nodes, a support vector machine web partition algorithm has been proposed. The algorithm reduces the load of the information collection system on the network through feature extraction, feature selection and support vector machine optimisation, thereby enhancing the response rate and crawling rate of the crawlers.