A feature selection approach based on term distributions

作者：Zhou, Hongfang^*; Guo, Jie; Wang, Yinghui

来源：SpringerPlus, 2016, 5(1): 249.

DOI：10.1186/s40064-016-1866-5

• Feature selection
• Term frequency
• Term distributions
• Text categorization

Feature selection has a direct impact on text categorization. Most existing algorithms are based on document level, and they haven't considered the influence of term frequency on text categorization. Based on these, we put forward a feature selection approach, FSATD, based on term distributions in the paper. In our proposed algorithm, three critical factors which are term frequency, the inter-class distribution and the intraclass distribution of the terms are all considered synthetically. Finally, experiments are made with the help of kNN classifier. And the corresponding results on 20NewsGroup and SougouCS corpus show that FSATD algorithm achieves better performance than DF and t-Test algorithms.

• 出版日期2016-3-1
• 单位西安理工大学