Automatic human action recognition in a scene from visual inputs

作者：Bouma Henri^*; Hanckmann Patrick; Marck Jan Willem; Penning Leo; den Hollander Richard; ten Hove Johan Martijn; van den Broek Sebastiaan; Schutte Klamer; Burghouts Gertjan

来源：Conference on Unattended Ground, Sea, and Air Sensor Technologies and Applications XIV, 2012-04-25 to 2012-04-26.

DOI：10.1117/12.918582

• Visual intelligence
• action recognition
• artificial intelligence
• retrieval
• computer vision

Surveillance is normally performed by humans, since it requires visual intelligence. However, this can be dull and dangerous, especially for military operations. Therefore, unmanned autonomous visual-intelligence systems are desired. In this paper, we present a novel system that can recognize human actions, which are relevant to detect operationally significant activity. Central to the system is a break-down of high-level perceptual concepts (verbs) in simpler observable events. The system is trained on 3482 videos and evaluated on 2589 videos from the DARPA Mind's Eye program, with for each video human annotations indicating the presence or absence of 48 different actions. The results show that our system reaches good performance approaching the human average response.

• 出版日期2012