A Low-Cost Implementation of a 360 degrees Vision Distributed Aperture System

作者：Peng, Xiaoming^*; Bennamoun, Mohammed; Wang, Qingbo; Ma, Qian; Xu, Zhiyong

来源：IEEE Transactions on Circuits and Systems for Video Technology, 2015, 25(2): 225-238.

DOI：10.1109/TCSVT.2014.2335832

• Bundle adjustment
• camera orientation estimation
• distributed aperture systems (DASs)
• GPU programming
• image registration
• image stitching
• real-time virtual view synthesis

Visible light cameras commonly used for surveillance applications usually have a limited field of view (FoV). To acquire a broader FoV, distributed aperture systems (DASs) combine views from multiple cameras. Although some commercial or proprietary systems already exist, the open literature in this field reports solely the performance and/or hardware architecture of the respective systems, and omits the required details for a reimplementation. In this paper we present a low-cost, personal-computer-based 360 degrees DAS, with a full description of the hardware architecture and the software implementation details. In particular, we describe in detail two problems, the offline estimation of the orientations of the cameras of the proposed DAS and the online synthesis of a virtual view in real time. For the first problem, we propose an area-based bundle adjuster by combining the forward additive Lucas-Kanade algorithm with a bundle adjustment strategy. The color virtual view of up to 2048 x 1024 pixels is synthesized online at 39 frames/s. A large majority of the workload of the online phase is implemented on the graphic processing unit. The techniques and methods proposed in this paper are generic and independent on the arrangement of cameras.

• 出版日期2015-2
• 单位电子科技大学; 中国科学院光电技术研究所