Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Association Areas of the Cortex01:21

Association Areas of the Cortex

6.4K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
6.4K
Color Vision01:24

Color Vision

736
Color perception begins in the retina, the light-sensitive layer at the back of the eye. Two main theories explain how colors are seen: the trichromatic theory and the opponent-process theory. The trichromatic theory, proposed by Thomas Young in 1802 and extended by Hermann von Helmholtz in 1852, suggests that color vision is based on three types of cone receptors in the retina. These cones are sensitive to different but overlapping ranges of wavelengths corresponding to red, blue, and green.
736
Depth Perception and Spatial Vision01:15

Depth Perception and Spatial Vision

972
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
972
Light Acquisition02:16

Light Acquisition

8.6K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.6K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Rapid Determination of Soybean Protein Content by Near-Infrared Spectroscopy Coupled with Multi-Learner Ensemble Wavelength Selection.

Foods (Basel, Switzerland)·2026
Same author

Key Indicator Detection and Authenticity Identification of Beer Based on Near-Infrared Spectroscopy Combined with Multi-Task Feature Extraction.

Molecules (Basel, Switzerland)·2026
Same author

Research on the Optimization of Uncertain Multi-Stage Production Integrated Decisions Based on an Improved Grey Wolf Optimizer.

Biomimetics (Basel, Switzerland)·2025
Same author

Progress in Polyurethane and Composites.

Polymers·2024
Same author

A Novel Polyfunctional Polyurethane Acrylate Derived from Castor Oil-Based Polyols for Waterborne UV-Curable Coating Application.

Polymers·2024

Related Experiment Video

Updated: Sep 18, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
03:31

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

650

CFANet: The Cross-Modal Fusion Attention Network for Indoor RGB-D Semantic Segmentation.

Long-Fei Wu1, Dan Wei1, Chang-An Xu2

  • 1School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai 201620, China.

Journal of Imaging
|June 25, 2025
PubMed
Summary
This summary is machine-generated.

This study introduces a novel approach for indoor image semantic segmentation using multi-head self-attention to fuse RGB and depth data. The method enhances feature alignment and fusion, outperforming existing techniques on benchmark datasets.

Keywords:
RGB-Dcross-modal fusionfeature extractionfeature interaction

More Related Videos

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment
08:25

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

9.1K
Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
04:48

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

3.0K

Related Experiment Videos

Last Updated: Sep 18, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
03:31

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

650
Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment
08:25

Combining Eye-tracking Data with an Analysis of Video Content from Free-viewing a Video of a Walk in an Urban Park Environment

Published on: May 7, 2019

9.1K
Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography
04:48

Application of Deep Learning-Based Medical Image Segmentation via Orbital Computed Tomography

Published on: November 30, 2022

3.0K

Area of Science:

  • Computer Vision
  • Artificial Intelligence
  • Machine Learning

Background:

  • Indoor image semantic segmentation is crucial for smart homes and security applications.
  • Existing methods using RGB images and depth maps face challenges like semantic gaps and information loss.

Purpose of the Study:

  • To develop an advanced semantic segmentation technique that effectively fuses RGB and depth data.
  • To overcome the limitations of current methods in capturing detailed and semantic information.

Main Methods:

  • A multi-head self-attention mechanism is employed for adaptive feature alignment and fusion across spatial and channel dimensions.
  • Specialized feature extraction techniques are designed for RGB images (asymmetric convolution, criss-cross attention) and depth maps (unimodal feature extraction).
  • A lightweight skip connection module and a feature refinement head are utilized for effective low-level and high-level feature integration.

Main Results:

  • The proposed method achieves a mean Intersection over Union (mIoU) of 53.86% on the NYUDv2 dataset.
  • The method achieves an mIoU of 51.85% on the SUN-RGBD dataset.
  • Performance surpasses mainstream semantic segmentation methods on both datasets.

Conclusions:

  • The developed approach effectively addresses the semantic gap and information loss in indoor image semantic segmentation.
  • The integration of multi-head self-attention and tailored feature extraction significantly improves segmentation accuracy.
  • This work offers a robust solution for enhanced indoor scene understanding in smart environments.