Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Titanium dioxide nanoparticles relieve biochemical dysfunctions of fifth-instar larvae of silkworms following exposure to phoxim insecticide.

Chemosphere·2012
Same author

Mechanisms of prostate atrophy after LHRH antagonist cetrorelix injection: an experimental study in a rat model of benign prostatic hyperplasia.

Journal of Huazhong University of Science and Technology. Medical sciences = Hua zhong ke ji da xue xue bao. Yi xue Ying De wen ban = Huazhong keji daxue xuebao. Yixue Yingdewen ban·2012
Same author

Simulation and experimental investigation of structural dynamic frequency characteristics control.

Sensors (Basel, Switzerland)·2012
Same author

Chronic clomipramine treatment restores hippocampal expression of glial cell line-derived neurotrophic factor in a rat model of depression.

Journal of affective disorders·2012
Same author

Application of nanoLC-MS/MS to the shotgun proteomic analysis of the nematocyst proteins from jellyfish Stomolophus meleagris.

Journal of chromatography. B, Analytical technologies in the biomedical and life sciences·2012
Same author

Identification of Sare0718 as an alanine-activating adenylation domain in marine actinomycete Salinispora arenicola CNS-205.

PloS one·2012

Related Experiment Video

Updated: Oct 26, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
06:37

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

4.6K

Interaction-Aware Spatio-Temporal Pyramid Attention Networks for Action Classification.

Weiming Hu, Haowei Liu, Yang Du

    IEEE Transactions on Pattern Analysis and Machine Intelligence
    |July 27, 2021
    PubMed
    Summary

    This study introduces an interaction-aware self-attention model to improve visual action recognition by focusing on key spatial and temporal features. The novel approach enhances Convolutional Neural Network (CNN) performance on action recognition datasets.

    More Related Videos

    Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
    04:48

    Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

    Published on: July 5, 2024

    586
    Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
    03:31

    Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

    Published on: December 15, 2023

    722

    Related Experiment Videos

    Last Updated: Oct 26, 2025

    Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention
    06:37

    Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

    Published on: December 15, 2023

    4.6K
    Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
    04:48

    Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

    Published on: July 5, 2024

    586
    Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
    03:31

    Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

    Published on: December 15, 2023

    722

    Area of Science:

    • Computer Vision
    • Artificial Intelligence
    • Machine Learning

    Background:

    • Convolutional Neural Networks (CNNs) are widely used for visual action recognition.
    • Self-attention mechanisms can improve accuracy by focusing on relevant features.
    • Existing self-attention methods often overlook spatial correlations in CNN feature maps.

    Purpose of the Study:

    • To propose an interaction-aware self-attention model for enhanced visual action recognition.
    • To address the limitation of ignoring correlations among local feature vectors in CNN feature maps.
    • To improve the accuracy of action recognition by effectively utilizing multi-scale and spatio-temporal information.

    Main Methods:

    • Developed an interaction-aware self-attention model to capture feature vector interactions for attention map generation.
    • Introduced a spatial pyramid incorporating feature maps from different CNN layers to model multi-scale information.
    • Extended the attention layer to a spatio-temporal version for video-level end-to-end action recognition.
    • Investigated methods for combining RGB and flow streams for accurate action prediction.

    Main Results:

    • The proposed model effectively extracts interaction information between feature vectors to learn attention maps.
    • Multi-scale information from different CNN layers, utilized via a spatial pyramid, led to more accurate attention scores.
    • The model achieved state-of-the-art results on benchmark datasets: UCF101, HMDB51, Kinetics-400, and untrimmed Charades.
    • The model demonstrated flexibility by being embeddable in general CNNs for end-to-end training.

    Conclusions:

    • The interaction-aware self-attention model significantly enhances visual action recognition accuracy.
    • The integration of multi-scale and spatio-temporal information is crucial for robust action recognition.
    • The proposed method offers a versatile and effective approach for embedding attention mechanisms into CNNs for video analysis.