Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Aggregating global-scale pixel-wise forgery cues within a graph.

Neural networks : the official journal of the International Neural Network Society·2026
Same author

DiMuS: Disentangled Multi-Signal Learning for Weakly Supervised Point-Based 3D Object Detection.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same author

Visual-Textual Information-Driven Tactile Data Generation Method.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026
Same author

Class Sensitive Calibration and Discrepancy-Aware Synthesis for Semi-Supervised Medical Image Segmentation.

IEEE journal of biomedical and health informatics·2026
Same author

Diffusion-based cross-staining feature transformation for whole slide image analysis: From H&E to IHC representation learning.

Medical image analysis·2026
Same author

SD-ReID: View-Aware Stable Diffusion for Aerial-Ground Person Re-Identification.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

Related Experiment Video

Updated: Aug 2, 2025

The Visual Colorimetric Detection of Multi-nucleotide Polymorphisms on a Pneumatic Droplet Manipulation Platform
10:01

The Visual Colorimetric Detection of Multi-nucleotide Polymorphisms on a Pneumatic Droplet Manipulation Platform

Published on: September 27, 2016

7.7K

Plug-and-Play Regulators for Image-Text Matching.

Haiwen Diao, Ying Zhang, Wei Liu

    IEEE Transactions on Image Processing : a Publication of the IEEE Signal Processing Society
    |April 18, 2023
    PubMed
    Summary
    This summary is machine-generated.

    This study introduces two novel regulators, Recurrent Correspondence Regulator (RCR) and Recurrent Aggregation Regulator (RAR), to enhance image-text matching by improving cross-modal representation. These plug-and-play modules significantly boost performance on standard datasets.

    More Related Videos

    Generating Strictly Controlled Stimuli for Figure Recognition Experiments
    05:39

    Generating Strictly Controlled Stimuli for Figure Recognition Experiments

    Published on: March 18, 2019

    5.3K
    Author Spotlight: Integrating Computational and Experimental Approaches in Precision Oncology
    07:03

    Author Spotlight: Integrating Computational and Experimental Approaches in Precision Oncology

    Published on: December 1, 2023

    965

    Related Experiment Videos

    Last Updated: Aug 2, 2025

    The Visual Colorimetric Detection of Multi-nucleotide Polymorphisms on a Pneumatic Droplet Manipulation Platform
    10:01

    The Visual Colorimetric Detection of Multi-nucleotide Polymorphisms on a Pneumatic Droplet Manipulation Platform

    Published on: September 27, 2016

    7.7K
    Generating Strictly Controlled Stimuli for Figure Recognition Experiments
    05:39

    Generating Strictly Controlled Stimuli for Figure Recognition Experiments

    Published on: March 18, 2019

    5.3K
    Author Spotlight: Integrating Computational and Experimental Approaches in Precision Oncology
    07:03

    Author Spotlight: Integrating Computational and Experimental Approaches in Precision Oncology

    Published on: December 1, 2023

    965

    Area of Science:

    • Computer Vision and Natural Language Processing
    • Artificial Intelligence
    • Machine Learning

    Background:

    • Image-text matching research leverages fine-grained correspondence and visual-semantic alignments.
    • Current methods often use one-time cross-modal attention and aggregation, lacking feedback regulation.
    • Existing approaches can be complex or require additional information for effective alignment.

    Purpose of the Study:

    • To develop novel, efficient regulators for contextualizing and aggregating cross-modal representations in image-text matching.
    • To improve the flexibility and effectiveness of capturing region-word interactions and alignments.
    • To introduce plug-and-play modules that enhance existing image-text matching frameworks.

    Main Methods:

    • Proposed Recurrent Correspondence Regulator (RCR) for progressive facilitation of cross-modal attention with adaptive factors.
    • Proposed Recurrent Aggregation Regulator (RAR) for iterative adjustment of aggregation weights to emphasize important alignments.
    • Integration of RCR and RAR as plug-and-play modules into existing cross-modal interaction frameworks.

    Main Results:

    • RCR and RAR demonstrated significant performance improvements when applied individually to multiple models.
    • Cooperative application of RCR and RAR yielded further substantial gains in image-text matching.
    • Consistent improvements in Recall@1 (R@1) were observed across MSCOCO and Flickr30K datasets.

    Conclusions:

    • The proposed RCR and RAR are effective and generalizable methods for enhancing image-text matching.
    • These regulators offer a simple yet powerful approach to improve cross-modal representation and alignment.
    • The plug-and-play nature of RCR and RAR allows for easy integration and broad applicability in related tasks.