Space-time image layout

作者：Ben Ezra Shahar^*; Cohen Or Daniel

来源：Visual Computer, 2018, 34(3): 417-430.

DOI：10.1007/s00371-016-1347-4

• Image organization
• Spatial ordering
• Temporal ordering
• Self-organizing maps

Cameras are now ubiquitous in our lives. A given activity is often captured by multiple people from different viewpoints resulting in a sizable collection of photograph footage. We present a method that effectively organizes this spatiotemporal content. Given an unorganized collection of photographs taken by a number of photographers, capturing some dynamic event at a number of time steps, we would like to organize the collection into a space-time table. The organization is an embedding of the photographs into clusters that preserve the viewpoint and time order. Our method relies on a self-organizing map (SOM), which is a neural network that embeds the training data (the set of images) into a discrete domain. We introduce BiSOM, which is a variation of SOM that considers two features (space and time) rather than a single one, to layout the given photograph collection into a table. We demonstrate our method on several challenging datasets, using different space and time descriptors.

• 出版日期2018-3