Automatic inpainting of linearly related video frames

作者：Xiao Yudong; Suo Jinli; Bian Liheng; Zhang Lei; Dai Qionghai

来源：2014 IEEE International Conference on Image Processing (ICIP), 2014-10-27 To 2014-10-30.

DOI：10.1109/ICIP.2014.7025951

• Augmented Lagrangian methods
• low rank
• Low-rank matrices
• Numerical solution
• Scene structure
• sparse
• Temporal consistency
• Video inpainting

This paper addresses automatic inpainting of a specific but common kind of videos captured by imaging a far or planar scene with a moving camera. The projective model tells that the frames of such videos can be approximately aligned by linear mappings except for some to-be-inpainted small regions. Mathematically, we treat inpainting as a global optimization with a linear system incorporating both the temporal consistency and the priors of the inpainting regions: (i) temporally registered frames form a low rank matrix;(ii) the pixels in the given inpainting regions destroy the low rank-ness with gross sparse errors. Besides, we also use a soft mask to ensure consistent global brightness before and after inpainting. Further, we propose a numerical solution to above optimization based on Augmented Lagrangian Method. The experiment results demonstrated our advantageous in both preserving thin scene structures and the details prone to be smoothed out by previous methods.

• 出版日期2014
• 单位清华大学