Arabic sign language continuous sentences recognition using PCNN and graph matching

作者：Tolba M F; Samir Ahmed^*; Aboul Ela Magdy

来源：Neural Computing & Applications, 2013, 23(3-4): 999-1010.

DOI：10.1007/s00521-012-1024-0

• Sign language
• Gesture
• Posture
• Arabic Sign Language Recognition (ASLR)
• Pulse-coupled neural network (PCNN)
• Graph matching
• Graph isomorphism and sub-graph

Many previous researchers have tried developing sign languages recognition systems in general and Arabic sign language specifically. They succeeded to achieve acceptable results for isolated gestures level, but none of them investigated the recognition of connected sequence of gestures. This paper focuses on how to recognize real-time connected sequence of gestures using graph-matching technique, also how the continuous input gestures are segmented and classified. Graphs are a general and powerful data structure useful for the representation of various objects and concepts. This work is a component of a real-time Arabic Sign Language Recognition system that applied pulse-coupled neural network for static posture recognition in its first phase. This work can be adapted and applied to different sign languages and other recognition problems.

• 出版日期2013-9