Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Search research articles

Related Experiment Video

Updated: Mar 24, 2026

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Gaze-enabled Egocentric Video Summarization via Constrained Submodular Maximization.

Jia Xut¹, Lopamudra Mukherjee², Yin Li³

¹University of Wisconsin-Madison.

Proceedings. IEEE Computer Society Conference on Computer Vision and Pattern Recognition

|March 15, 2016

Summary

This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Temporally Multi-Scale Sparse Self-Attention for Physical Activity Data Imputation.

Proceedings of machine learning research·2024

Same author

Ego4D: Around the World in 3,600 Hours of Egocentric Video.

IEEE transactions on pattern analysis and machine intelligence·2024

Same author

In the Eye of Transformer: Global-Local Correlation for Egocentric Gaze Estimation and Beyond.

International journal of computer vision·2024

Same author

mRisk: Continuous Risk Estimation for Smoking Lapse from Noisy Sensor Data with Incomplete and Positive-Only Labels.

Proceedings of the ACM on interactive, mobile, wearable and ubiquitous technologies·2023

Same author

A deep learning framework for classifying microglia activation state using morphology and intrinsic fluorescence lifetime data.

Frontiers in neuroinformatics·2023

Same author

Differentiable Optimization of Generalized Nondecomposable Functions using Linear Programs.

Advances in neural information processing systems·2022

This study introduces gaze tracking for egocentric video summarization, creating personalized, compact video summaries. This approach improves content representation for wearable camera footage.

Area of Science:

Computer Science
Artificial Intelligence
Human-Computer Interaction

Background:

Wearable cameras generate vast amounts of egocentric video data.
Existing video summarization methods perform poorly on egocentric videos due to quality issues and camera motion.
There is a need for efficient methods to create compact, browsable summaries of personal life videos.

Purpose of the Study:

To develop an effective egocentric video summarization technique.
To leverage gaze tracking data to enhance video summarization.
To create personalized video summaries that reflect the wearer's intent.

Main Methods:

Utilized gaze tracking data (fixations, saccades) to inform video summarization.
Formulated a summarization model based on common-sense properties of good summaries.

More Related Videos

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

Related Experiment Videos

Last Updated: Mar 24, 2026

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Eye Tracking During Visually Situated Language Comprehension: Flexibility and Limitations in Uncovering Visual Context Effects

Published on: November 30, 2018

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

Solved the summarization problem as a submodular function maximization with partition matroid constraints.

Main Results:

Gaze tracking significantly improves egocentric video summarization.
The proposed model enables the creation of personalized video summaries.
Demonstrated effectiveness on a new, large-scale gaze-enabled egocentric video dataset.

Conclusions:

Gaze tracking is a valuable feature for egocentric video summarization.
Submodular optimization provides a robust framework for personalized video summarization.
The developed dataset will facilitate future research in egocentric video analysis.