A New Language Model Adaptation Framework Using Modification of Structures of Background Corpus and Language Model

作者：Lv Zhenyu; Liu Wenju; Yang Zhanlei

来源：IEEE International Conference on Natural Language Processing and Knowledge Engineering, China,Shaanxi,Weinan,Dali, 2009-09-24 to 2009-09-27.

DOI：10.1109/nlpke.2009.5313748

• Language model adaptation
• MAP
• MDI
• linear interpolation
• modification

This paper presents a new framework of language model adaptation based on modification of structures of background corpus and language model. The widely used adaptation approach such as Linear Interpolation Method (LI) and Minimum Discrimination Information (MDI) method are used as the approaches to modify structure of trained background language model in new framework, while Maximum A Posteriori approach (MAP) is used as the method of modifying structure of background corpus. Experiments show that both techniques in the framework yield a significant reduction in perplexity over LI, MAP and MDI method in general adaptation framework about 5.2%, 12.2% and 36.8% respectively.

• 出版日期2009
• 单位中国科学院