MyJournals Home  

RSS FeedsSensors, Vol. 18, Pages 1979: Action Recognition by an Attention-Aware Temporal Weighted Convolutional Neural Network (Sensors)


26 june 2018 10:17:02

Sensors, Vol. 18, Pages 1979: Action Recognition by an Attention-Aware Temporal Weighted Convolutional Neural Network (Sensors)

Research in human action recognition has accelerated significantly since the introduction of powerful machine learning tools such as Convolutional Neural Networks (CNNs). However, effective and efficient methods for incorporation of temporal information into CNNs are still being actively explored in the recent literature. Motivated by the popular recurrent attention models in the research area of natural language processing, we propose the Attention-aware Temporal Weighted CNN (ATW CNN) for action recognition in videos, which embeds a visual attention model into a temporal weighted multi-stream CNN. This attention model is simply implemented as temporal weighting yet it effectively boosts the recognition performance of video representations. Besides, each stream in the proposed ATW CNN framework is capable of end-to-end training, with both network parameters and temporal weights optimized by stochastic gradient descent (SGD) with back-propagation. Our experimental results on the UCF-101 and HMDB-51 datasets showed that the proposed attention mechanism contributes substantially to the performance gains with the more discriminative snippets by focusing on more relevant video segments. Digg Facebook Google StumbleUpon Twitter
96 viewsCategory: Chemistry, Physics
Sensors, Vol. 18, Pages 1980: Validity, Test-Retest Reliability and Long-Term Stability of Magnetometer Free Inertial Sensor Based 3D Joint Kinematics (Sensors)
Sensors, Vol. 18, Pages 1978: Spectral-Spatial Feature Extraction of Hyperspectral Images Based on Propagation Filter (Sensors)
blog comments powered by Disqus
The latest issues of all your favorite science journals on one page


Register | Retrieve



Use these buttons to bookmark us: Digg Facebook Google StumbleUpon Twitter

Valid HTML 4.01 Transitional
Copyright © 2008 - 2019 Indigonet Services B.V.. Contact: Tim Hulsen. Read here our privacy notice.
Other websites of Indigonet Services B.V.: Nieuws Vacatures News Tweets Travel Photos Nachrichten Indigonet Finances Leer Mandarijn