Asymmetries in Unimodal Visual Vowel Perception: The Roles of Oral-Facial Kinematics, Orientation, and Configuration

作者：Masapollo Matthew^*; Polka Linda; Menard Lucie; Franklin Lauren; Tiede Mark; Morgan James

来源：Journal of Experimental Psychology: Human Perception and Performance , 2018, 44(7): 1103-1118.

DOI：10.1037/xhp0000518

• visual speech perception
• natural referent vowel framework
• focal vowels
• eye-tracking
• point-light stimuli

Masapollo, Polka, and Menard (2017) recently reported a robust directional asymmetry in unimodal visual vowel perception: Adult perceivers discriminate a change from an English /u/ viseme to a French /u/ viseme significantly better than a change in the reverse direction. This asymmetry replicates a frequent pattern found in unimodal auditory vowel perception that points to a universal bias favoring more extreme vocalic articulations, which lead to acoustic signals with increased formant convergence. In the present article, the authors report 5 experiments designed to investigate whether this asymmetry in the visual realm reflects a speech-specific or general processing bias. They successfully replicated the directional effect using Masapollo et al.'s dynamically articulating faces but failed to replicate the effect when the faces were shown under static conditions. Asymmetries also emerged during discrimination of canonically oriented point-light stimuli that retained the kinematics and configuration of the articulating mouth. In contrast, no asymmetries emerged during discrimination if rotated point-light stimuli or Lissajou patterns that retained the kinematics, but not the canonical orientation or spatial configuration, of the labial gestures. These findings suggest that the perceptual processes underlying asymmetries in unimodal visual vowel discrimination are sensitive to speech-specific motion and configural properties and raise foundational questions concerning the role of specialized and general processes in vowel perception.

• 出版日期2018-7
• 单位McGill