A weakly supervised method for makeup-invariant face verification

作者：Sun, Yao; Ren, Lejian; Wei, Zhen; Liu, Bin; Zhai, Yanlong; Liu, Si^*

来源：Pattern Recognition, 2017, 66: 153-159.

DOI：10.1016/j.patcog.2017.01.011

• Face verification
• Makeup-invariant
• Weakly supervised method
• Video context
• Triplet loss function

Face verification, which aims to determine whether two face images belong to the same identity, is an important task in multimedia area. Face verification becomes more challenging when the person is wearing makeup. However, collecting sufficient makeup and non-makeup image pairs are tedious, which brings great challenges for deep learning methods of face verification. In this paper, we propose a new weakly supervised method for face verification. Our method takes advantages of the plentiful video resources available from the Internet. Our face verification model is pre-trained on the free videos and fine-tuned on small makeup and non-makeup datasets. To fully exploit the video contexts and the limited makeup and non-makeup datasets, many techniques are used to improve the performance. A novel loss function with a triplet term and two pairwise terms is defined, and multiple facial parts are combined by the proposed voting strategy to generate better verification results. Experiments on a benchmark dataset (Guo et al., 2014) [1] and a newly collected face dataset show the priority of the proposed method.

• 出版日期2017-6
• 单位北京理工大学; 中国科学院信息工程研究所