Multitask Feature Learning for Low-Resource Query-by-Example Spoken Term Detection

作者：Chen, Hongjie; Leung, Cheung-Chi; Xie, Lei^*; Ma, Bin; Li, Haizhou

来源：IEEE Journal of Selected Topics in Signal Processing, 2017, 11(8): 1329-1339.

DOI：10.1109/JSTSP.2017.2764270

• Query-by-example
• spoken term detection
• multitask learning
• bottle-neck feature

We propose a novel technique that learns a low-dimensional feature representation from unlabeled data of a target language, and labeled data from a nontarget language. The technique is studied as a solution to query-by-example spoken term detection (QbE-STD) for a low-resource language. We extract low-dimensional features from a bottle-neck layer of a multitask deep neural network, which is jointly trained with speech data from the low-resource target language and resource-rich nontarget language. The proposed feature learning technique aims to extract acoustic features that offer phonetic discriminability. It explores a new way of leveraging cross-lingual speech data to overcome the resource limitation in the target language. We conduct QbE-STD experiments using the dynamic time warping distance of the multitask bottle-neck features between the query and the search database. The QbE-STD process does not rely on an automatic speech recognition pipeline of the target language. We validate the effectiveness of multitask feature learning through a series of comparative experiments.

• 出版日期2017-12
• 单位西北工业大学