A hybrid neural network hidden Markov model approach for automatic story segmentation

作者：Yu, Jia^*; Xie, Lei; Xiao, Xiong; Chng, Eng Siong

来源：Journal of Ambient Intelligence and Humanized Computing, 2017, 8(6): 925-936.

DOI：10.1007/s12652-017-0501-9

• Neural network
• Long short-term memory
• Hidden Markov model
• Multi-task learning
• Story segmentation
• Topic modeling

We propose a hybrid neural network hidden Markov model (NN-HMM) approach for automatic story segmentation. A story is treated as an instance of an underlying topic (a hidden state) and words are generated from the distribution of the topic. The transition from one topic to another indicates a story boundary. Different from the traditional HMM approach, in which the emission probability of each state is calculated from a topic-dependent language model, we use deep neural network (DNN) to directly map the word distribution into topic posterior probabilities. DNN is known to be able to learn meaningful continuous features for words and hence has better discriminative and generalization capability than n-gram models. Specifically, we investigate three neural network structures: a feed-forward neural network, a recurrent neural network with long short-term memory cells (LSTM-RNN) and a modified LSTM-RNN with multi-task learning ability. Experimental results on the TDT2 corpus show that the proposed NN-HMM approach outperforms the traditional HMM approach significantly and achieves state-of-the-art performance in story segmentation.

• 出版日期2017-11
• 单位洛阳理工学院; 南阳理工学院; 西北工业大学