Audiovisual Tool for Solfege Assessment

作者：Schramm Rodrigo; Nunes Helena De Souza; Jung Claudio Rosito

来源：ACM Transactions on Multimedia Computing, Communications, and Applications, 2017, 13(1): 9.

DOI：10.1145/3007194

• Sight-singing
• melodic transcription
• meter-mimicking
• automatic assessment
• music education
• Solfege

Solfege is a general technique used in the music learning process that involves the vocal performance of melodies, regarding the time and duration of musical sounds as specified in the music score, properly associated with the meter-mimicking performed by hand movement. This article presents an audiovisual approach for automatic assessment of this relevant musical study practice. The proposed system combines the gesture of meter-mimicking (video information) with the melodic transcription (audio information), where hand movement works as a metronome, controlling the time flow (tempo) of the musical piece. Thus, meter-mimicking is used to align the music score (ground truth) with the sung: melody; allowing assessment even in time-dynamic scenarios. Audio analysis is applied to achieve the melodic transcription of the sung notes and the solfege performances are evaluated by a set of Bayesian classifiers that were generated from real evaluations done by experts listeners.

• 出版日期2017-1