Automatic Transcription of Polyphonic Piano Music Using Genetic Algorithms, Adaptive Spectral Envelope Modeling, and Dynamic Noise Level Estimation

作者：Reis Gustavo^*; Fernandez de Vega Francisco; Ferreira Anibal

来源：IEEE Transactions on Audio Speech and Language Processing, 2012, 20(8): 2313-2328.

DOI：10.1109/TASL.2012.2201475

• Acoustic signal analysis
• automatic music transcription
• fundamental frequency (F0) estimation
• music information retrieval
• pitch perception

This paper presents a new method for multiple fundamental frequency (F0) estimation on piano recordings. We propose a framework based on a genetic algorithm in order to analyze the overlapping overtones and search for the most likely F0 combination. The search process is aided by adaptive spectral envelope modeling and dynamic noise level estimation: while the noise is dynamically estimated, the spectral envelope of previously recorded piano samples (internal database) is adapted in order to best match the piano played on the input signals and aid the search process for the most likely combination of F0s. For comparison, several state-of-the-art algorithms were run across various musical pieces played by different pianos and then compared using three different metrics. The proposed algorithm ranked first place on Hybrid Decay/Sustain Score metric, which has better correlation with the human hearing perception and ranked second place on both onset-only and onset-offset metrics. A previous genetic algorithm approach is also included in the comparison to show how the proposed system brings significant improvements on both quality of the results and computing time. Index Terms-Acoustic signal analysis, automatic