Alpha-numeric hand gesture recognition based on fusion of spatial feature modelling and temporal feature modelling

作者：Yang C; Ku B; Han D K; Ko H^*

来源：Electronics Letters, 2016, 52(20): 1679-1680.

DOI：10.1049/el.2016.0841

• gesture recognition
• feature extraction
• handwritten character recognition
• computer vision
• neural nets
• performance evaluation
• alpha-numeric hand gesture recognition
• spatial feature modelling
• alphabet
• numeric characters
• vision enabled smart devices
• user interface
• handwriting style
• individualistic styles
• vision based gesture recognition
• temporal-feature-state modelling
• total-trajectory-shape modelling
• convolution neural network
• conditional random fields
• public database

Alpha-numeric gesture refers to writing in air of alphabet and numeric characters. With prevalent usage of vision enabled smart devices, these gestures are considered as an alternative user interface. As each individual has a unique handwriting style, it has been observed that alpha-numeric gesturing also exhibits different individualistic styles, posing a challenge to the vision based gesture recognition. In this Letter, a simple but effective method of modelling alpha-numeric hand gestures by fusing temporal-feature-state modelling and total-trajectory-shape modelling is proposed. The proposed method employs a convolution neural network that represents total-trajectory-shapes, and combines it with conventional conditional random fields based temporal-feature-state modelling. The proposed algorithm is evaluated in public database of both alphabet and numeric hand gestures. Experimental results show a performance improvement of the proposed algorithm compared with the state-of-the art methods.

• 出版日期2016-9-29