Source sentence simplification for statistical machine translation

作者:Hasler Eva*; de Gispert Adria; Stahiberg Felix; Waite Aurelien; Byrne Bill
来源:Computer Speech and Language, 2017, 45: 221-235.
DOI:10.1016/j.csl.2016.12.001

摘要

Long sentences with complex syntax and long-distance dependencies pose difficulties for machine translation systems. Short sentences, on the other hand, are usually easier to translate. We study the potential of addressing this mismatch using text simplification: given a simplified version of the full input sentence, can we use it in addition to the full input to improve translation? We show that the spaces of original and simplified translations can be effectively combined using translation lattices and compare two decoding approaches to process both inputs at different levels of integration. We demonstrate on source-annotated portions of WMT test sets and on top of strong baseline systems combining hierarchical and neural translation for two language pairs that source simplification can help to improve translation quality.

  • 出版日期2017-9