A three-phase approach to document clustering based on topic significance degree

作者：Ma, Yinglong^*; Wang, Yao; Jin, Beihong

来源：Expert Systems with Applications, 2014, 41(18): 8203-8210.

DOI：10.1016/j.eswa.2014.07.014

• Document clustering
• Topic model
• K-means
• K-means plus

Topic model can project documents into a topic space which facilitates effective document clustering. Selecting a good topic model and improving clustering performance are two highly correlated problems for topic based document clustering. In this paper, we propose a three-phase approach to topic based document clustering. In the first phase, we determine the best topic model and present a formal concept about significance degree of topics and some topic selection criteria, through which we can find the best number of the most suitable topics from the original topic model discovered by LDA. Then, we choose the initial clustering centers by using the k-means++ algorithm. In the third phase, we take the obtained initial clustering centers and use the k-means algorithm for document clustering. Three clustering solutions based on the three phase approach are used for document clustering. The related experiments of the three solutions are made for comparing and illustrating the effectiveness and efficiency of our approach.

• 单位
  中国科学院; 华北电力大学