A Hybrid Model for Chinese Spelling Check

作者：Zhao, Hai^*; Cai, Deng; Xin, Yang; Wang, Yuzhu; Jia, Zhongye

来源：ACM Transactions on Asian and Low-Resource Language Information Processing, 2017, 16(3): 21.

DOI：10.1145/3047405

• Chinese spelling check
• hybrid model
• graph model
• conditional random field
• rule-based model

Spelling check for Chinese has more challenging difficulties than that for other languages. A hybrid model for Chinese spelling check is presented in this article. The hybrid model consists of three components: one graph-based model for generic errors and two independently trained models for specific errors. In the graph model, a directed acyclic graph is generated for each sentence, and the single-source shortest-path algorithm is performed on the graph to detect and correct general spelling errors at the same time. Prior to that, two types of errors over functional words (characters) are first solved by conditional random fields: the confusion of (at) (pinyin is zai in Chinese), (again, more, then) (pinyin: zai) and (of) (pinyin: de), (- ly, adverb- forming particle) (pinyin: de), and (so that, have to) (pinyin: de). Finally, a rule- based model is exploited to distinguish pronoun usage confusion: (she) (pinyin: ta), (he) (pinyin: ta), and some other common collocation errors. The proposed model is evaluated on the standard datasets released by the SIGHAN Bake-off shared tasks, giving state-of-the-art results.

• 出版日期2017-4
• 单位上海交通大学