Automatic objects segmentation with RGB-D cameras

作者：Liu Haowei^*; Philipose Matthai; Sun Ming Ting

来源：Journal of Visual Communication and Image Representation, 2014, 25(4): 709-718.

DOI：10.1016/j.jvcir.2013.03.012

• Boundary detection
• Object segmentation
• Trilateral filter
• Graph Cuts

Automatic object segmentation is a fundamentally difficult problem due to issues such as shadow, lighting, and semantic gaps. Edges play a critical role in object segmentation; however, it is almost impossible for the computer to know which edges correspond to object boundaries and which are caused by internal texture discontinuities. Active 3-D cameras, which provide streams of depth and RGB frames, are poised to become inexpensive and widespread. The depth discontinuities provide useful information for identifying object boundaries, which makes automatic object segmentation possible. However, the depth frames are extremely noisy. Also, the depth and RGB information often lose synchronization when the object is moving fast, due to different response time of the RGB and depth sensors. We show how to use the combined depth and RGB information to mitigate these problems and produce an accurate silhouette of the object. On a large dataset (24 objects with 1500 images), we provide both qualitative and quantitative evidences that our proposed techniques are effective.

• 出版日期2014-5