Anomalous Behaviors Detection in Moving Crowds Based on a Weighted Convolutional Autoencoder-Long Short-Term Memory Network

作者：Yang, Biao; Cao, Jinmeng; Wang, Nan; Liu, Xiaofeng^*

来源：IEEE Transactions on Cognitive and Developmental Systems, 2019, 11(4): 473-482.

DOI：10.1109/TCDS.2018.2866838

• Anomaly detection
• Adaptive optics
• Feature extraction
• Gallium nitride
• Optical losses
• Generative adversarial networks
• Optical network units
• Anomaly detection
• anomaly localization
• convolutional autoencoder (AE)
• long short-term memory network
• weighted Euclidean loss

We propose an anomaly detection approach by learning a generative model of moving pedestrians to guarantee public safety. To resolve the existing challenges of anomaly detection in complicated definitions, complex backgrounds, and local occurrence, a weighted convolutional autoencoder-long short-term memory network is proposed to reconstruct raw data and their corresponding optical flow and then perform anomaly detection based on reconstruction errors. Unlike equally treating raw data and optical flow, a novel two-stream framework is proposed to take the reconstructed optical flow as supplementary cues that encode pedestrian motions. A weighted Euclidean loss is proposed to enable the network to concentrate on moving foregrounds, thus restraining background influence. Global-local analysis is used to jointly detect and localize local anomaly in reconstructed raw data. Final detection of anomalous events is achieved by jointly considering the results of the global-local analysis and reconstructed optical flow. Qualitative evaluations verify the effectiveness of our two-stream framework, the weighted Euclidean loss, and the global-local analysis. Moreover, comparisons with state-of-the-art approaches indicate the superiority of our approach in anomaly detection.

• 出版日期2019-12
• 单位河海大学; 常州大学; 中国海洋大学