AllFocus: Patch-Based Video Out-of-Focus Blur Reconstruction

作者:Wang, Yinting; Wang, Zhenyang; Tao, Dapeng*; Zhuo, Shaojie; Xu, Xianghua; Pu, Shiliang; Song, Mingli
来源:IEEE Transactions on Circuits and Systems for Video Technology, 2017, 27(9): 1895-1908.
DOI:10.1109/TCSVT.2016.2555740

摘要

Amateur videos always contain focusing issues. A focusing mistake may produce out-of-focus blur, which seriously degrades the expressive force of the video. In this paper, we propose a patch-based method to remove the out-of-focus blur of a video and build an all-in-focus video. We assume that the out-of-focus blurry region in one frame will be clear in a portion of other frames; thus, the clear corresponding regions can be used to reconstruct the blurry one. We divide each video frame into a grid of patches and track each patch in the surrounding frames. We independently reconstruct each video frame by building a Markov random field model to identify the optimal target patches that are sharp, similar to the original patches, and are coherent with their neighboring patches within the overlapped regions. To recover an all-in-focus video, an iterative framework is utilized, in which the reconstructed video of each iteration is substituted in the next iteration. Finally, we employ the idea of a bilateral filter to temporally smooth the reconstructed video. The experimental results and the comparison with the previous works demonstrate the effectiveness of our method.