An adapted data selection for deep learning-based audio segmentation in multi-genre broadcast channel

作者：Yang, Xu-Kui; Qu, Dan^*; Zhang, Wen-Lin; Zhang, Wei-Qiang

来源：Digital Signal Processing, 2018, 81: 8-15.

DOI：10.1016/j.dsp.2018.03.004

• Deep learning
• Audio segmentation
• Voice activity detection
• Long-term information
• Multi-genre broadcast

Broadcast audio transcription is still a challenging problem because of the complexity of diverse speech and audio signals. Audio segmentation, which is an essential module in a broadcast audio transcription system, has benefited greatly from the development of deep learning theory. However, the need of large amounts of labeled training data becomes a bottleneck of deep learning-based audio segmentation methods. To tackle this problem, an adapted segmentation method is proposed to select speech/nonspeech segments with high confidence from unlabeled training data as complements to the labeled training data. The new method relies on GMM-based speech/non-speech models trained on an utteranceby-utterance basis. The long-term information is used to choose reliable training data for speech/nonspeech models from the utterances at hand. Experimental results show that this data selection method is a powerful audio segmentation algorithm of its own. We also observed that the deep neural networks trained using data selected by this method are superior to those trained with data chosen by two comparing methods. Moreover, better performance could be obtained by combining the deep learning-based audio segmentation method with the adapted data selection method.

• 出版日期2018-10
• 单位清华大学