An auxiliary gaze point estimation method based on facial normal

作者：Sun, Wei^*; Sun, Nan; Guo, Baolong; Jia, Wenyan; Sun, Mingui

来源：Pattern Analysis and Applications, 2016, 19(3): 611-620.

DOI：10.1007/s10044-014-0407-5

• Binocular vision
• Viola-Jones framework
• Integro-differential operators
• Plane fitting
• Facial normal

Considering the main disadvantage of the existing gaze point estimation methods which restrict user's head movement and have potential injury on eyes, we propose a gaze point estimation method based on facial normal and binocular vision. Firstly, we calibrate stereo cameras to determine the extrinsic and intrinsic parameters of the cameras; Secondly, face is quickly detected by Viola-Jones framework and the center position of the two irises can be located based on integro-differential operators; The two nostrils and mouth are detected based on the saturation difference and their 2D coordinates can be calculated; Thirdly, the 3D coordinates of these five points are obtained by stereo matching and 3D reconstruction; After that, a plane fitting algorithm based on least squares is adopted to get the approximate facial plane, then, the normal via the midpoint of the two pupils can be figured out; Finally, the point-of-gaze can be obtained by getting the intersection point of the facial normal and the computer screen. Experimental results confirm the accuracy and robustness of the proposed method.

• 出版日期2016-8
• 单位西安电子科技大学