A Neutral Probabilistic Structured-Prediction Method for Transition-Based Natural Language Processing

作者:Zhou Hao*; Zhang Yue; Cheng Chuan; Huang Shujian; Dai Xinyu; Chen Jiajun
来源:Journal of Artificial Intelligence Research, 2017, 58: 703-29.

摘要

We propose a neural probabilistic structured-prediction method for transition-based natural language processing, which integrates beam search and contrastive learning. The method uses a global optimization model, which can leverage arbitrary features over nonlocal context. Beam search is used for efficient heuristic decoding, and contrastive learning is performed for adjusting the model according to search errors. When evaluated on both chunking and dependency parsing tasks, the proposed method achieves significant accuracy improvements over the locally normalized greedy baseline on the two tasks, respectively.