摘要

The present work aims to examine emotion recognition within and across cultures. It reports on a set of perceptual experiments designed to explore the human ability to identify emotional expressions dynamically presented through visual and auditory channels. Two cross-modal databases of dynamic verbal and non-verbal emotional stimuli based on video-clips extracted from American and Italian movies, respectively, were defined and exploited for the experiments. In the first study, American, French, and Italian subjects were involved in a comparative analysis of subjective perceptions of six emotional states dynamically portrayed by visual and vocal cues, exploiting the database of American emotional stimuli. In the second study, American and Italian subjects were tested on their ability to recognize six emotional states through the visual and auditory channel, exploiting the database of Italian emotional stimuli. The aim is to investigate if there exists a difference in the efficacy of the visual and auditory channels to infer emotional information and if cultural context, in particular the language, may influence this difference. This hypothesis is investigated including as participants in each of the two studies, one group of native speakers of the language, belonging to the same cultural context of the video-clips used as stimuli (i.e., American subjects for the American stimuli in the former study, and Italian subjects for the Italian stimuli in the latter one). Results showed that emotional information is affected by the communication mode and that language plays a role.

  • 出版日期2012