An Approach to Score Following for Piano Performances With the Sustained Effect

作者：Li Bochen^*; Duan Zhiyao

来源：IEEE-ACM Transactions on Audio Speech and Language Processing, 2016, 24(12): 2425-2438.

DOI：10.1109/TASLP.2016.2611938

• Audio-score alignment
• reverberation
• score following
• sustain pedal

One challenge in score following for piano music is the sustained effect, i.e., the waveform of a note lasts longer than what is notated in the score. This can be caused by expressive performing styles such as the legato articulation and the usage of the sustain and the sostenuto pedals and can also be caused by the reverberation in the recording environment. This effect creates nonnotated overlappings between sustained notes and latter notes in the audio. It decreases the audio-score alignment accuracy and robustness of score following systems and makes them be prone to delay errors, i.e., aligning audio to a score position that is earlier than the correct position. In this paper, we propose to modify the feature representation of the audio to attenuate the sustained effect. We show that this idea can be applied to both the chromagram and the spectral-peak representations, which are commonly used in score following systems. Experiments on the MAPS dataset show that the proposed method significantly improves the alignment accuracy and robustness of score following systems for piano performances, in both anechoic and highly reverberant environments.

• 出版日期2016-12