Adjudication of coreference annotations via answer set optimisation

作者:Schueller Peter
来源:Journal of Experimental & Theoretical Artificial Intelligence, 2018, 30(4): 525-546.
DOI:10.1080/0952813X.2018.1456793

摘要

We describe the first automatic approach for merging coreference annotations obtained from multiple annotators into a single gold standard. This merging is subject to certain linguistic hard constraints and optimisation criteria that prefer solutions with minimal divergence from annotators. The representation involves an equivalence relation over a large number of elements. We use Answer Set Programming to describe two representations of the problem and four objective functions suitable for different data-sets. We provide two structurally different real-world benchmark data-sets based on the METU-Sabanci Turkish Treebank and we report our experiences in using the Gringo, Clasp and Wasp tools for computing optimal adjudication results on these data-sets.

  • 出版日期2018