Audio-Visual Underdetermined Blind Source Separation Algorithm Based on Gaussian Potential Function

作者：Zhang Ye^*; Cao Kang; Wu Kangrui; Yu Tenglong; Zhou Nanrun

来源：China Communications, 2014, 11(6): 71-80.

DOI：10.1109/cc.2014.6879005

• underdetermined blind source separation
• interaural time difference
• interaural level difference
• visual information
• Gaussian potential function

Most existing algorithms for the underdetermined blind source separation (UBSS) problem are two-stage algorithm, i.e., mixing parameters estimation and sources estimation. In the mixing parameters estimation, the previously proposed traditional clustering algorithms are sensitive to the initializations of the mixing parameters. To reduce the sensitiveness to the initialization, we propose a new algorithm for the UBSS problem based on anechoic speech mixtures by employing the visual information, i.e., the interaural time difference (ITD) and the interaural level difference (ILD), as the initializations of the mixing parameters. In our algorithm, the video signals are utilized to estimate the distances between microphones and sources, and then the estimations of the ITD and ILD can be obtained. With the sparsity assumption in the time-frequency domain, the Gaussian potential function algorithm is utilized to estimate the mixing parameters by using the ITDs and ILDs as the initializations of the mixing parameters. And the time-frequency masking is used to recover the sources by evaluating the various ITDs and ILDs. Experimental results demonstrate the competitive performance of the proposed algorithm compared with the baseline algorithms.

• 出版日期2014-6
• 单位北京邮电大学; 南昌大学