Using deep belief networks to extract Chinese entity attribute relation in domain-specific

作者：Xian Yantuan; Shao Fa; Guo Jianyi^*; Zhou Lanjiang; Yu Zhengtao; Chen Wei

来源：International Journal of Computing Science and Mathematics, 2016, 7(2): 144-155.

DOI：10.1504/IJCSM.2016.076422

• Chinese entity attribute
• combination features
• deep belief nets
• LM algorithm
• Relation extraction

The state-of-the-art methods used for entity attribute relation extraction are primarily based on statistical machine learning, and the performance strongly depends on the quality of the extracted features. Deep belief networks (DBN) has been successful in the high dimensional feature space information extraction task, which can without complicated pre-processing. In this paper, the DBN, which consists of one or more restricted Boltzmann machine (RBM) layers and a back-propagation (BP) layer, is presented to extract Chinese entity attribute relation in domain-specific. First, the word tokens are transformed to vectors by looking up word embeddings. Then, the RBM layers maintain as much information as possible when feature vectors are transferred to next layer. Finally, the BP layer is trained to classify the features generated by the last RBM layer, and adopting Levenberg-Marquard (LM) optimisation algorithm to do the training. The experimental results show that the proposed method outperforms state-of-the-art learning models in specific domain entity attribute relation extraction.

• 出版日期2016