A Text Categorization Method using Extended Vector Space Model by Frequent Term Sets

作者：Yuan, Man; Ouyang, Yuan Xin^*; Xiong, Zhang

来源：Journal of Information Science and Engineering, 2013, 29(1): 99-114.

• text categorization
• text representation
• frequent term sets
• Apriori
• SVM

Text categorization is one of the most important research topics in Natural Language Processing and Information Retrieval due to the ever-increasing electronic documents. This paper presents a new text categorization method using frequent term sets. A novel constraint measure AD-Sup was introduced to extract discriminative features from frequent term sets for classification task. Then text documents are represented in the global feature space which contains both single terms and frequent term sets. To solve the sparse instance problem, a term weighting strategy is then implemented which assigns estimated weights using feature similarity and highly reduces the sparse rate. Through extensive experiments, the optimal proportion of single features and frequent term set features is empirically determined. Classification results on Reuters-21578 and WebKB corpus demonstrate that AD-Sup constraint is effective to extract useful frequent features and the combination strategy is effective to build better feature space and improve the SVM classifier.

• 出版日期2013-1
• 单位北京航空航天大学; 北京航空航天大学深圳研究院