Search research articles

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Reconstructing Three-Dimensional Models of Interacting Humans.

IEEE transactions on pattern analysis and machine intelligence·2025

Same author

Free-Form Region Description with Second-Order Pooling.

IEEE transactions on pattern analysis and machine intelligence·2015

Same author

Generalized Boundaries from Multiple Image Interpretations.

IEEE transactions on pattern analysis and machine intelligence·2015

Same author

Human3.6M: Large Scale Datasets and Predictive Methods for 3D Human Sensing in Natural Environments.

IEEE transactions on pattern analysis and machine intelligence·2015

Same author

CPMC: Automatic Object Segmentation Using Constrained Parametric Min-Cuts.

IEEE transactions on pattern analysis and machine intelligence·2011

Same author

BM3 E: discriminative density propagation for visual tracking.

IEEE transactions on pattern analysis and machine intelligence·2007

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Video

Updated: Apr 4, 2026

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Actions in the Eye: Dynamic Gaze Datasets and Learnt Saliency Models for Visual Recognition.

Stefan Mathe, Cristian Sminchisescu

IEEE Transactions on Pattern Analysis and Machine Intelligence

|September 10, 2015

Summary

This study introduces the first large-scale human eye-tracking dataset for video action recognition, revealing stable visual search patterns. These insights enable the development of advanced computer vision systems that achieve state-of-the-art performance by predicting human fixations.

More Related Videos

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Published on: April 11, 2025

Gaze in Action: Head-mounted Eye Tracking of Children's Dynamic Visual Attention During Naturalistic Behavior

Gaze in Action: Head-mounted Eye Tracking of Children's Dynamic Visual Attention During Naturalistic Behavior

Published on: November 14, 2018

Related Experiment Videos

Last Updated: Apr 4, 2026

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Published on: April 11, 2025

Gaze in Action: Head-mounted Eye Tracking of Children's Dynamic Visual Attention During Naturalistic Behavior

Gaze in Action: Head-mounted Eye Tracking of Children's Dynamic Visual Attention During Naturalistic Behavior

Published on: November 14, 2018

Area of Science:

Computer Vision
Human-Computer Interaction
Neuroscience

Background:

Current computer vision systems use bag-of-words models from sparse interest points for object and action recognition.
While computer vision and human visual processing share similarities (saccade and fixate regimes), their methodologies remain distinct.
Bridging this gap requires integrating human visual behavior data into computer vision models.

Purpose of the Study:

To create the first large-scale, publicly available human eye-tracking dataset for dynamic computer vision tasks.
To analyze the stability and patterns of human visual search during action and scene recognition.
To develop and evaluate end-to-end trainable computer vision systems that leverage human eye movement data.

Main Methods:

Collected human eye movements from 19 subjects viewing 497,107 frames of dynamic video stimuli under task-controlled and free-viewing conditions.
Developed novel dynamic consistency and alignment measures to analyze visual search patterns.
Built and trained end-to-end computer vision systems using predicted human fixations and advanced computer vision techniques.

Main Results:

The study presents a unique, large-scale dataset for video action recognition, crucial for computer vision research.
Analysis revealed remarkable stability in human visual search patterns across subjects.
Human eye movements (fixations) were accurately predicted and demonstrated to improve computer vision system performance.

Conclusions:

Human eye-tracking data offers valuable insights for advancing computer vision, particularly in action and scene recognition.
The developed dataset and methods facilitate the creation of more biologically plausible and effective computer vision systems.
Leveraging human fixation predictions in end-to-end systems achieves state-of-the-art recognition results, highlighting the potential of human-computer synergy.