A Facial Expression Emotion Recognition Based Human-robot Interaction System

作者：Liu, Zhentao; Wu, Min^*; Cao, Weihua; Chen, Luefeng; Xu, Jianping; Zhang, Ri; Zhou, Mengtian; Mao, Junwei

来源：IEEE/CAA Journal of Automatica Sinica, 2017, 4(4): 668-676.

DOI：10.1109/JAS.2017.7510622

• Emotion generation
• facial expression emotion recognition (FEER)
• human-robot interaction (HRI)
• system design

A facial expression emotion recognition based human-robot interaction (FEER-HRI) system is proposed, for which a four-layer system framework is designed. The FEERHRI system enables the robots not only to recognize human emotions, but also to generate facial expression for adapting to human emotions. A facial emotion recognition method based on 2D-Gabor, uniform local binary pattern (LBP) operator, and multiclass extreme learning machine (ELM) classifier is presented, which is applied to real-time facial expression recognition for robots. Facial expressions of robots are represented by simple cartoon symbols and displayed by a LED screen equipped in the robots, which can be easily understood by human. Four scenarios, i. e., guiding, entertainment, home service and scene simulation are performed in the human-robot interaction experiment, in which smooth communication is realized by facial expression recognition of humans and facial expression generation of robots within 2 seconds. As a few prospective applications, the FEERHRI system can be applied in home service, smart home, safe driving, and so on.

• 出版日期2017-10
• 单位中国地质大学（北京）