Related Experiment Video
Updated: Mar 2, 2026

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment
Published on: May 7, 2019
KE-VUM: Knowledge-enhanced video understanding model for fine-grained movie description
Xiaojing Gu1, Gen Xu2, Xiaolu Zhang2
1University of Chinese Academy of Sciences, Beijing, China.
None:
Fine-grained movie description is challenging due to limited annotations and persistent cross-modal semantic gaps, especially for clips with complex and long-range narrative structures. Existing video description models rarely exploit structured knowledge from movie scripts, resulting in shallow, subtitle-like semantics and frequent character confusion. We propose KE-VUM, a knowledge-enhanced video understanding model that performs collaborative reasoning between a video-based multimodal backbone and a script knowledge base. The backbone first produces a draft description, which is refined by a script-guided two-stage optimization strategy: entity and relationship correction using a script-derived knowledge graph, followed by narrative reconstruction aligned with script-level plot progressions to improve temporal and causal coherence. To support evaluation, we construct the MovieClip benchmark of narrative-rich movie clips and develop VD-Eval, an LLM-based framework that jointly measures Semantic Accuracy Score (SAS) and Narrative Coherence Score (NCS). Experiments on MovieClip show that KE-VUM consistently outperforms strong baselines in both descriptive accuracy and narrative coherence, achieving a 6.7% absolute improvement in BERTScore F1 and maintaining robust performance in delayed-narrative scenarios.
Related Concept Videos
Stereotype Content Model
Observational Learning
Relative Motion Analysis - Velocity
When an external force is exerted, it sets the crank into a rotational movement. This, in turn, instigates the motion of the connecting rod, leading to what is referred to as a general plane motion. This process involves two key points - point A on the connecting rod...
Induced-fit Model
Enzymes exhibit substrate specificity, meaning that they can only bind to certain substrates. This is mainly determined by the shape and chemical...