Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Improving Translational Accuracy

Improving Translational Accuracy

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

Deep learning framework for automated classification of thoracolumbar fractures using spinal CT images.

Health informatics journal·2026

Same author

Multi-view Chest X-Ray Vision-Language Pre-training via Semantic-Aware Masked Language Modeling and High-order Alignment.

IEEE transactions on medical imaging·2026

Same author

Tri-Level Consistency-Diversity Calibration for Multi-View Representation Learning.

Entropy (Basel, Switzerland)·2026

Same author

RLSFmode: A deep learning approach for predicting RNA-small molecule binding modes via molecular surface modeling.

International journal of biological macromolecules·2026

Same author

Mask-Guided Proxy Mining Network for Few-Shot Medical Image Segmentation.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

Same author

LTOFusion: A Learning-to-Optimize Framework With Flow Matching for Unsupervised Image Fusion.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2026

Search research articles

Related Experiment Video

Updated: Sep 18, 2025

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Published on: October 27, 2023

SC-CoSF: Self-Correcting Collaborative and Co-Training for Image Fusion and Semantic Segmentation.

Dongrui Yang¹, Lihong Qiao^1,2, Yucheng Shu^1,2

¹Key Laboratory of Big Data Intelligent Computing, Chongqing University of Posts and Telecommunications, Chongqing 400065, China.

Sensors (Basel, Switzerland)

|June 27, 2025

Summary

This summary is machine-generated.

We introduce SC-CoSF, a novel framework for multimodal image fusion and semantic segmentation in autonomous systems. This approach enhances performance by jointly optimizing tasks, improving both fusion quality and segmentation accuracy.

Keywords:

co-training multimodal image fusion self-correction semantic segmentation

More Related Videos

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Related Experiment Videos

Last Updated: Sep 18, 2025

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Author Spotlight: An Efficient and Robust Software for Automated Fusion of Multiple Preclinical Imaging Modalities

Published on: October 27, 2023

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Area of Science:

Computer Vision
Artificial Intelligence
Robotics

Background:

Multimodal image fusion and semantic segmentation are crucial for autonomous systems.
Their interdependence is underexplored, leading to performance bottlenecks.

Purpose of the Study:

To propose SC-CoSF, a novel coupled framework for joint optimization of image fusion and semantic segmentation.
To address the underexplored interdependence and overcome performance limitations.

Main Methods:

Utilizes a weight-sharing CNN encoder for implicit multimodal feature alignment and reduced parameters.
Introduces a Self-correction and Collaboration Fusion Module (Sc-CFM) with Self-correction Long-Range Relationship Branch (Sc-LRB) and Self-correction Fine-Grained Branch (Sc-FGB).
Employs Dual-branch Collaborative Recalibration (DCR), Interactive Context Recovery Mamba Decoder (ICRM), and Region Adaptive Weighted Reconstruction Decoder (ReAW).

Main Results:

Demonstrates significant improvements in fusion quality compared to independently optimized baselines.
Achieves superior segmentation accuracy through synergistic learning and cross-task feature refinement.
Preserves critical edge textures and color contrasts while reducing feature redundancy.

Conclusions:

SC-CoSF effectively leverages inter-task consistency for enhanced performance in multimodal image fusion and semantic segmentation.
Joint optimization via end-to-end training enables gradient propagation for superior results.
The proposed framework offers a promising solution for autonomous driving and robotic systems.