Narrative Collage of Image Collections by Scene Graph Recombination

作者：Fang, Fei; Yi, Miao; Feng, Hui; Hu, Shenghong; Xiao, Chunxia^*

来源：IEEE Transactions on Visualization and Computer Graphics, 2018, 24(9): 2559-2572.

DOI：10.1109/TVCG.2017.2759265

• Narrative collage
• image collections
• image segmentation
• scene graphs
• image synthesis

A narrative collage is an interesting image editing method for summarizing the main theme or storyline behind an image collection. We present a novel method to generate narrative images with plausible semantic scene structures. To achieve this goal, we introduce a layer graph and a scene graph to represent the relative depth order and semantic relationship between image objects, respectively. We first cluster the input image collection to select representative images, and then we extract a group of semantic salient objects from each representative image. Both layer graphs and scene graphs are constructed and combined according to our specific rules for reorganizing the extracted objects in every image. We design an energy model to appropriately locate every object on the final canvas. The experimental results show that our method can produce competitive narrative collage results and that it performs well on a wide range of image collections.

• 出版日期2018-9
• 单位武汉大学; 湖北经济学院