Multimodal interaction with virtual worlds XMMVR: eXtensible language for MultiModal interaction with virtual reality worlds

作者：Olmedo Hector^*; Escudero David; Cardenoso Valentin

来源：Journal on Multimodal User Interfaces, 2015, 9(3): 153-172.

DOI：10.1007/s12193-015-0176-5

• Spoken interaction
• Graphical interaction
• Human-computer interaction
• Multimodality Dialogue systems
• Avatar
• Virtual environments
• 3D virtual reality
• Rich internet applications
• Behavior

Based on a philosophy of integrating components from multimodal interaction applications with 3D graphical environments, reusing already defined markup language for describing graphics, graphical and spoken interactions based on the interactive movie metaphor, a markup language for modeling scenes, behavior and interaction is sought. With the definition of this language, we hope to have a common framework for developing applications that allow multimodal interaction at 3D stages. Thus we have defined the basis of an architecture that allows us to integrate the components of such multimodal interaction applications in 3D virtual environments.

• 出版日期2015-9