科研之友
微信
新浪微博
Facebook
分享链接
摘要
The natural user interface/experience (NUI/NUX) is used for a natural motion interface without using a device or tool such as a mouse, keyboard, pen, or marker. Up to now, typical motion recognition methods have used markers to receive coordinate input values as relative data and store them in a database. However, to recognize accurate motion, more markers are needed, and much time is required to attach the makers and process the data. In addition, because the NUI/NUX framework is developed using only basic intuition, use problems arise, which force users to learn many NUI/NUX framework usages. To compensate for this problem, in this paper, we design a multi-modal NUI/NUX framework controlled by voice, gesture motion, and facial expression simultaneously, and propose a new algorithm for mouse operations by analyzing intuitive hand gestures and mapping them on the monitor. We also implement a "dynamic mouse area," which enables people of all ages to handle the "hand mouse" operation easily and intuitively.
- 出版日期2016-12
