ALBAYZIN Query-by-example Spoken Term Detection 2016 evaluation

作者：Tejedor Javier^*; Toledano Doroteo T; Lopez Otero Paula; Docio Fernandez Laura; Proenca Jorge; Perdigao Fernando; Garcia Granada Fernando; Sanchis Emilio; Pompili Anna; Abad Alberto

来源：EURASIP Journal on Audio Speech and Music Processing, 2018, 2018(1): 2.

DOI：10.1186/s13636-018-0125-9

• Query-by-example Spoken Term Detection
• International evaluation
• Spanish
• Search on spontaneous speech

Query-by-example Spoken Term Detection (QbE STD) aims to retrieve data from a speech repository given an acoustic (spoken) query containing the term of interest as the input. This paper presents the systems submitted to the ALBAYZIN QbE STD 2016 Evaluation held as a part of the ALBAYZIN 2016 Evaluation Campaign at the IberSPEECH 2016 conference. Special attention was given to the evaluation design so that a thorough post-analysis of the main results could be carried out. Two different Spanish speech databases, which cover different acoustic and language domains, were used in the evaluation: the MAVIR database, which consists of a set of talks from workshops, and the EPIC database, which consists of a set of European Parliament sessions in Spanish. We present the evaluation design, both databases, the evaluation metric, the systems submitted to the evaluation, the results, and a thorough analysis and discussion. Four different research groups participated in the evaluation, and a total of eight template matching-based systems were submitted. We compare the systems submitted to the evaluation and make an in-depth analysis based on some properties of the spoken queries, such as query length, single-word/multi-word queries, and in-language/out-of-language queries.

• 出版日期2018-4-13