Novel Two-Stage Audiovisual Speech Filtering in Noisy Environments

作者：Abel Andrew^*; Hussain Amir

来源：Cognitive Computation, 2014, 6(2): 200-217.

DOI：10.1007/s12559-013-9231-2

• Speech enhancement
• Multimodal speech filtering
• Audiovisual speech processing

In recent years, the established link between the various human communication production domains has become more widely utilised in the field of speech processing. In this work, we build on previous work by the authors and present a novel two-stage audiovisual speech enhancement system, making use of audio-only beamforming, automatic lip tracking, and pre-processing with visually derived Wiener speech filtering. Initial results have demonstrated that this two-stage multimodal speech enhancement approach can produce positive results with noisy speech mixtures that conventional audio-only beamforming would struggle to cope with, such as in very noisy environments with a very low signal to noise ratio, and when the type of noise is difficult for audio-only beamforming to process.

• 出版日期2014-6