A semantic term weighting scheme for text categorization

作者:Luo Qiming*; Chen Enhong; Xiong Hui
来源:Expert Systems with Applications, 2011, 38(10): 12708-12716.
DOI:10.1016/j.eswa.2011.04.058

摘要

Traditional term weighting schemes in text categorization, such as TF-IDF, only exploit the statistical information of terms in documents. Instead, in this paper, we propose a novel term weighting scheme by exploiting the semantics of categories and indexing terms. Specifically, the semantics of categories are represented by senses of terms appearing in the category labels as well as the interpretation of them by WordNet. Also, the weight of a term is correlated to its semantic similarity with a category. Experimental results on three commonly used data sets show that the proposed approach outperforms TF-IDF in the cases that the amount of training data is small or the content of documents is focused on well-defined categories. In addition, the proposed approach compares favorably with two previous studies.

全文