Computational auditory induction as a missing-data model-fitting problem with Bregman divergence

作者：Le Roux Jonathan^*; Kameoka Hirokazu; Ono Nobutaka; de Cheveigne Alain; Sagayama Shigeki

来源：Speech Communication, 2011, 53(5): 658-676.

DOI：10.1016/j.specom.2010.08.009

• Auditory induction
• Acoustical scene analysis
• Missing data
• Auxiliary function
• Bregman divergence
• EM algorithm
• Non-negative matrix factorization
• Harmonic-temporal clustering

The human auditory system has the ability, known as auditory induction, to estimate the missing parts of a continuous auditory stream briefly covered by noise and perceptually resynthesize them. In this article, we formulate this ability as a model-based spectrogram analysis and clustering problem with missing data, show how to solve it using an auxiliary function method, and explain how this method is generally related to the expectation-maximization (EM) algorithm for a certain type of divergence measures called Bregman divergences, thus enabling the use of prior distributions on the parameters. We illustrate how our method can be used to simultaneously analyze a scene and estimate missing information with two algorithms: the first, based on non-negative matrix factorization (NMF), performs analysis of polyphonic multi-instrumental musical pieces. Our method allows this algorithm to cope with gaps within the audio data, estimating the timbre of the instruments and their pitch, and reconstructing the missing parts. The second, based on a recently introduced technique for the analysis of complex acoustical scenes called harmonic-temporal clustering (FITC), enables us to perform robust fundamental frequency estimation from incomplete speech data.

• 出版日期2011-6