Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Q-Bone system: an intelligent quantitative system for alveolar bone loss to assist the diagnosis of periodontitis - model development and validation.

Journal of translational medicine·2026

Same author

EmoPoseFace: Head Pose Aware Speech- driven 3D Emotional Facial Animation Using Latent Diffusion.

IEEE transactions on visualization and computer graphics·2026

Same author

DSA-DET: a tea disease detection algorithm based on dynamic spatial pyramid and polarized linear attention.

Frontiers in plant science·2026

Same author

MedSAM-guided geometry-aware 2D-3D feature fusion for medical image registration.

Neural networks : the official journal of the International Neural Network Society·2026

Same author

Blue LED illumination in a submerged wave-driven reciprocating plate photobioreactor enhances Chlorella sp. biomass productivity and carbon fixation efficiency.

Bioprocess and biosystems engineering·2026

Same author

Deep learning-driven detection of municipal sludge moisture content based on feature images of compressed slices.

Journal of environmental management·2026

Same journal

Relation DETR+: Exploring Explicit Position Relation Prior for Dense Prediction.

IEEE transactions on pattern analysis and machine intelligence·2026

Same journal

RBF++: Quantifying and Optimizing Reasoning Boundaries across Measurable and Unmeasurable Capabilities for Chain-of-Thought Reasoning.

IEEE transactions on pattern analysis and machine intelligence·2026

Same journal

CAFE: Cross-View Adaptive Fusion and Cluster Center Enhancement for Robust Multi-View Clustering.

IEEE transactions on pattern analysis and machine intelligence·2026

Same journal

DIVER: Reinforced Diffusion Breaks Imitation Bottlenecks in End-to-End Autonomous Driving.

IEEE transactions on pattern analysis and machine intelligence·2026

Same journal

Ethics-Aware Safe Reinforcement Learning for Rare-Event Risk Control in Interactive Urban Driving.

IEEE transactions on pattern analysis and machine intelligence·2026

Same journal

Learning Shape Anchors for Holistic Indoor Scene Understanding.

IEEE transactions on pattern analysis and machine intelligence·2026

See all related articles

Search research articles

Related Experiment Video

Updated: May 24, 2025

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Published on: April 11, 2025

WinDB: HMD-free and Distortion-free Panoptic Video Fixation Learning.

Guotao Wang, Chenglizhao Chen, Aimin Hao

IEEE Transactions on Pattern Analysis and Machine Intelligence

|March 3, 2025

Summary

This summary is machine-generated.

Head-mounted displays (HMDs) fail to capture comprehensive fixation data for panoptic video due to "blind zooms." A new dynamic blurring approach (WinDB) and dataset (PanopticVideo-300) overcome this, enabling better fixation prediction models like FishNet.

More Related Videos

Assessing Binocular Central Visual Field and Binocular Eye Movements in a Dichoptic Viewing Condition

Assessing Binocular Central Visual Field and Binocular Eye Movements in a Dichoptic Viewing Condition

Published on: July 21, 2020

Stereoacuity Improvement using Random-Dot Video Games

Stereoacuity Improvement using Random-Dot Video Games

Published on: January 14, 2020

Related Experiment Videos

Last Updated: May 24, 2025

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss

Published on: April 11, 2025

Assessing Binocular Central Visual Field and Binocular Eye Movements in a Dichoptic Viewing Condition

Assessing Binocular Central Visual Field and Binocular Eye Movements in a Dichoptic Viewing Condition

Published on: July 21, 2020

Stereoacuity Improvement using Random-Dot Video Games

Stereoacuity Improvement using Random-Dot Video Games

Published on: January 14, 2020

Area of Science:

Computer Vision
Human-Computer Interaction
Machine Learning

Background:

Current fixation collection for panoptic video relies on head-mounted displays (HMDs).
HMD-based methods suffer from "blind zooms," leading to incomplete fixation data.
This limits the training of deep models for predicting salient regions in complex scenes.

Purpose of the Study:

To introduce a novel fixation collection method for panoptic video that overcomes HMD limitations.
To release a new dataset for training and evaluating fixation prediction models.
To develop a network capable of handling fixation shifting phenomena.

Main Methods:

Developed the auxiliary window with dynamic blurring (WinDB) approach for HMD-free fixation collection.
Created the PanopticVideo-300 dataset with 300 panoptic clips and 225 categories.
Proposed the fixation shifting network (FishNet) to address fixation shifting.

Main Results:

WinDB effectively collects fixation data without "blind zooms," reflecting regional importance.
The PanopticVideo-300 dataset captures frequent "fixation shifting," a previously overlooked phenomenon.
FishNet demonstrates effectiveness in handling fixation shifting for improved prediction.

Conclusions:

The WinDB approach and PanopticVideo-300 dataset offer a significant advancement in fixation data collection.
The developed FishNet model addresses the challenges of fixation shifting in panoptic video.
These contributions pave the way for new research and applications in 360° environments.