Census-based Vision for Auditory Depth Images and Speech Navigation of Visually Impaired Users

作者：Pei Soo Chang^*; Wang Yu Ying

来源：IEEE Transactions on Consumer Electronics, 2011, 57(4): 1883-1890.

• Visual imagery
• depth image
• Image-To-Sound Mapping (ITSM)
• sparse Census transform (SCT)

In neuroscience and psychology, visual imagery is the subjective experience of seeing in the absence of visual stimulation. Someone may experience touch or sound as a result of visual imagery. In this paper, a new visual image aid which can provide a different way to visualize the image for visually impaired users is proposed. It is done by applying the depth image to an Image-To-Sound Mapping (ITSM) system. The proposed algorithm utilizes a sparse Census transform (SCT) and color segmentation to obtain an illumination-invariant depth image. The depth image is applied to the ITSM system and then a clear and simple sound output is obtained for constructing a mental image. Moreover, the reliable three-dimensional (3D) data of close objects are extracted and interpreted as a semantic speech output. Experimental results show that visually impaired users can perceive the image easily and without training by adding verbal description to the visually image aid. In good and poor illuminated environments, the performance is 82% and 80% respectively. The performance of our proposed systems was not influenced by various lighting. All subjects also commented that the systems would be potentially useful(1).

• 出版日期2011-11