Related Experiment Video

Updated: Mar 14, 2026

Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues
07:34

Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues

Published on: June 3, 2013

18.0K

External Guidance Incomplete Cross-Modal Hashing

Jiali Chen, Ruitao Pu, Dezhong Peng

    IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society
    |March 12, 2026
    PubMed

    Abstract:

    Cross-modal hashing (CMH) aims to bridge the semantic gap between heterogeneous modalities by learning compact binary representations for efficient retrieval. Most existing deep cross-modal hashing methods are developed under the assumption that multimodal data are complete and perfectly paired across modalities. However, this assumption rarely holds as real-world multimodal datasets often suffer from missing modalities due to inconsistencies, imbalances, or noise during data collection. To address such incomplete data, existing incomplete CMH methods typically attempt to reconstruct the missing information by exploiting internal signals from the available modalities. Nonetheless, these internally guided completion strategies tend to be highly sensitive to distributional shifts, leading to substantial performance degradation on unseen or out-of-distribution data. Inspired by the human learning mechanism of enhancing cognition through external knowledge, this paper proposes a novel External Guidance Incomplete Cross-modal Hashing (EGICH) framework to address this limitation. Specifically, we first design a Completion with External Guidance (CEG) module that leverages rich semantic information from external knowledge bases to expand the semantic boundary and accurately reconstruct the semantics of missing samples. Subsequently, we introduce a Consistency Learning with External Guidance (CLEG) module, which employs externally guided reconstructed features as anchors to align sample representations with label semantics, thereby effectively mitigating cross-modal bias. Finally, a Semantic-aware Contrastive Hashing (SCH) module is developed to refine the feature distribution by semantic similarity, pulling semantically related samples closer and pushing unrelated ones apart, thus achieving fine-grained discrimination among positive pairs. To the best of our knowledge, this is the first attempt to incorporate external knowledge into incomplete cross-modal hashing. Extensive experiments demonstrate that EGICH consistently and significantly outperforms 11 state-of-the-art methods under various modality-missing scenarios. The code is available at https://github.com/chenjiali27/EGICH.

    More Related Videos

    Cross-Modal Multivariate Pattern Analysis
    13:51

    Cross-Modal Multivariate Pattern Analysis

    Published on: November 9, 2011

    20.6K
    The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm
    06:43

    The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

    Published on: July 26, 2013

    16.7K

    Related Experiment Videos

    Last Updated: Mar 14, 2026

    Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues
    07:34

    Perceptual and Category Processing of the Uncanny Valley Hypothesis' Dimension of Human Likeness: Some Methodological Issues

    Published on: June 3, 2013

    18.0K
    Cross-Modal Multivariate Pattern Analysis
    13:51

    Cross-Modal Multivariate Pattern Analysis

    Published on: November 9, 2011

    20.6K
    The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm
    06:43

    The Crossmodal Congruency Task as a Means to Obtain an Objective Behavioral Measure in the Rubber Hand Illusion Paradigm

    Published on: July 26, 2013

    16.7K

    Related Concept Videos

    Collisions in Multiple Dimensions: Problem Solving01:06

    Collisions in Multiple Dimensions: Problem Solving

    5.6K
    In multiple dimensions, the conservation of momentum applies in each direction independently. Hence, to solve collisions in multiple dimensions, we should write down the momentum conservation in each direction separately. To help understand collisions in multiple dimensions, consider an example.
    A small car of mass 1,200 kg traveling east at 60 km/h collides at an intersection with a truck of mass 3,000 kg traveling due north at 40 km/h. The two vehicles are locked together. What is the...
    5.6K
    Law of Independent Assortment02:03

    Law of Independent Assortment

    64.1K
    While Mendel’s Law of Segregation states that the two alleles for one gene are separated into different gametes, a different question of how different genes are inherited remains. For example, is the gene for tall plants inherited with the gene for green peas? Mendel asked this question by experimenting with a dihybrid cross; a cross in which both parents are homozygous for two distinct traits resulting in an F1 generation that are heterozygous for both traits.
    64.1K
    Law of Independent Assortment02:03

    Law of Independent Assortment

    7.8K
    7.8K

    Articles linked to this work by shared authors, journal, and citation graph.

    Cerebrospinal fluid mechanics across CNS barriers: from production, circulation, and clearance to mechanomedicine.

    Frontiers in neuroscience·2026

    NOTO: Noise-Tolerate Evidential Learning for Open-Set Cross-Modal Retrieval.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

    Comparative efficacy of executive function interventions for Chinese children with neurodevelopmental disorders: A network meta-analysis.

    Frontiers in psychology·2026

    Frailty status and the risk of dementia, Alzheimer's disease: a meta-analysis of observational studies.

    Frontiers in neurology·2026

    Deep Information-Balanced Multimodal Learning.

    IEEE transactions on pattern analysis and machine intelligence·2026

    Social isolation, loneliness and the risk of Frailty status: a meta-analysis of observational studies.

    Archives of gerontology and geriatrics·2026

    A Robust Real-world Change Detection Transformer.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

    DeshadowMamba: Deshadowing as 1D Sequential Similarity.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

    Satellite-borne Vehicles Tracking: A Motion Position Graph Approach and Dataset.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

    Hyperspectral Image Denoising via Dynamically Adjusted Regional Rank Guided by Adaptive Superpixel Segmentation.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

    Dual-Stream Alignment for Action Segmentation.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

    Blind Attribute Quality Enhancement for G-PCC Compressed Dynamic Point Clouds.

    IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

    pycmplot: fast, low-memory multi-track circular and linear Manhattan plotting in Python.

    Bioinformatics advances·2026

    Differentiable optimization of Fourier-plane phase mask for high-fidelity phase-only holography.

    Optics express·2026

    Image classification using spectral features from a Kerr comb photonic reservoir computer.

    Optics express·2026

    Color formation as a Hilbert space operator: quotient structures and limits of metamerism.

    Journal of the Optical Society of America. A, Optics, image science, and vision·2026

    Robust multimodal emotion recognition under incomplete modalities via transformer conditional variational autoencoders.

    iScience·2026
    See all related articles
    JoVE
    x logofacebook logolinkedin logoyoutube logo
    ABOUT JoVE
    OverviewLeadershipBlogJoVE Help Center
    AUTHORS
    Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
    LIBRARIANS
    TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
    RESEARCH
    JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
    EDUCATION
    JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
    Terms & Conditions of Use
    Privacy Policy
    Policies
    Jove
    Visualize
    Contact Us