Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Vision01:24

Vision

Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
Observational Learning01:12

Observational Learning

Albert Bandura's observational learning, also known as imitation or modeling, occurs when a person observes and imitates another's behavior. It is a quicker process than operant conditioning. A well-known example is the Bobo doll study, where children who saw an adult acting aggressively towards the doll were more likely to act aggressively when left alone, compared to those who observed a nonaggressive adult. Many psychologists view observational learning as a form of latent learning because...
Depth Perception and Spatial Vision01:15

Depth Perception and Spatial Vision

Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
Extraction: Advanced Methods00:56

Extraction: Advanced Methods

Metal ions can be separated from one another by complexation with organic ligands–the chelating agent– to form uncharged chelates. Here, the chelating agent must contain hydrophobic groups and behave as a weak acid, losing a proton to bind with the metal. Since most organic ligands used in this process are insoluble or undergo oxidation in the aqueous phase, the chelating agent is initially added to the organic phase and extracted into the aqueous phase. The metal-ligand complex is formed in...
Heuristics01:21

Heuristics

Heuristics are problem-solving strategies that use mental shortcuts to simplify decision-making. Unlike algorithms, which must be followed precisely to achieve a correct result, heuristics offer a general problem-solving framework. They save time and energy but can sometimes lead to less rational decisions.
People often rely on heuristics when faced with an overload of information, limited time, low importance of the decision, limited information, or when a heuristic readily comes to mind. For...
Deconvolution01:20

Deconvolution

Deconvolution, also known as inverse filtering, is the process of extracting the impulse response from known input and output signals. This technique is vital in scenarios where the system's characteristics are unknown, and they must be inferred from the observable signals.
Deconvolution involves several mathematical techniques to derive the impulse response. One common approach is polynomial division. In this method, the input and output sequences are treated as coefficients of...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Sex-specific effects of depression on the incidence and risk factors for coronary heart disease: insights from multi-omics approaches.

European journal of preventive cardiology·2026
Same author

Quantitative comparison of similarities and differences in medicinal materials used by Tibetan medicine and the three traditional medicines (6th-10th Century AD).

Journal of ethnobiology and ethnomedicine·2026
Same author

Increased serum phenylalanine and tyrosine concentration related to inflammation in patients with primary angiitis of the central nervous system.

Biochemistry and biophysics reports·2026
Same author

20(S)-hydroxycholesterol, a natural allosteric agonist of Smoothened, exerts neuroprotective effects associated with angiogenesis and vascular plasticity following ischemia.

Biomedicine & pharmacotherapy = Biomedecine & pharmacotherapie·2026
Same author

Twisted Hybrid-Quadruple-Borylated MR-TADF Emitter Bridged by B─N─B Bond With Sub-10 nm Full-Width at Half-Maximum and Fast Reverse Intersystem Crossing.

Advanced materials (Deerfield Beach, Fla.)·2026
Same author

The Trajectory of Retinal Microcirculation Imaging: From Angiography to Artificial Intelligence.

Journal of visualized experiments : JoVE·2026

Related Experiment Video

Updated: Jun 4, 2026

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment
08:25

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

SAGE: Semantic-guided framework with decoupled optimization for open-vocabulary video visual relationship detection.

Shiqi Wang1, Weiying Xue1, Shuyi Hu1

  • 1School of Future Technology, South China University of Technology, Guangzhou, 511442, China.

Neural Networks : the Official Journal of the International Neural Network Society
|June 2, 2026
PubMed
Summary

This study introduces a novel framework (SAGE) for open-vocabulary video visual relationship detection, improving accuracy by decoupling semantic reasoning and classifier adaptation. The method enhances detection of unseen relationships in videos.

Keywords:
Cross-attention mechanismMultimodal large language modelOpen-vocabulary video visual relationship detectionSemantic-guided framework

Related Experiment Videos

Last Updated: Jun 4, 2026

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment
08:25

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

Area of Science:

  • Computer Vision
  • Artificial Intelligence
  • Machine Learning

Background:

  • Open-vocabulary video visual relationship detection (VidVRD) aims to identify relationships between objects in videos beyond predefined categories.
  • Current methods struggle with the visual-semantic gap and instability in dynamic video data, often adapting static image-text models.
  • Low-level visual features and instance-level noise (blur, occlusion) hinder accurate detection of subtle spatio-temporal interactions.

Purpose of the Study:

  • To develop a robust framework for open-vocabulary VidVRD that addresses limitations of existing approaches.
  • To improve the detection of unseen relationships between seen and unseen objects in videos.
  • To mitigate semantic ambiguity and noise sensitivity inherent in video data.

Main Methods:

  • Proposed a Semantic-Guided Framework with Decoupled Optimization (SAGE) to separate semantic reasoning from classifier adaptation.
  • Introduced a Multimodal LLM-based Semantic Teacher to extract structured descriptions, bridging the spatio-temporal gap via cross-attention.
  • Developed a Decoupled Class-Aware Prompting strategy using a Textual Knowledge Embedding network to create adaptive prompts, reducing noise sensitivity.

Main Results:

  • The SAGE framework achieved state-of-the-art performance on VidVRD and VidOR datasets.
  • Demonstrated significant improvements in detecting novel relationship categories.
  • Effectively reduced semantic drift and classification inconsistency caused by visual noise.

Conclusions:

  • The proposed SAGE framework offers a significant advancement in open-vocabulary video visual relationship detection.
  • Decoupling semantic reasoning and employing class-aware prompting effectively handles the complexities of video data.
  • The method shows strong generalization capabilities, particularly for identifying novel and challenging visual relationships.