High-Quality Real-Time Video Inpainting with PixMix

作者：Herling Jan^*; Broll Wolfgang

来源：IEEE Transactions on Visualization and Computer Graphics, 2014, 20(6): 866-879.

DOI：10.1109/TVCG.2014.2298016

• Video inpainting
• diminished reality
• real-time
• image inpainting
• image completion
• object removal

While image inpainting has recently become widely available in image manipulation tools, existing approaches to video inpainting typically do not even achieve interactive frame rates yet as they are highly computationally expensive. Further, they either apply severe restrictions on the movement of the camera or do not provide a high-quality coherent video stream. In this paper we will present our approach to high-quality real-time capable image and video inpainting. Our PixMix approach even allows for the manipulation of live video streams, providing the basis for real Diminished Reality (DR) applications. We will show how our approach generates coherent video streams dealing with quite heterogeneous background environments and non-trivial camera movements, even applying constraints in real-time.

• 出版日期2014-6