Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Parallel Processing01:20

Parallel Processing

440
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
440

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Amodal Segmentation and Trait Extraction of On-Branch Soybean Pods with a Synthetic Dual-Mask Dataset.

Sensors (Basel, Switzerland)·2025
Same author

Driving-Related Cognitive Abilities Prediction Based on Transformer's Multimodal Fusion Framework.

Sensors (Basel, Switzerland)·2025
Same author

EasyDAM_V2: Efficient Data Labeling Method for Multishape, Cross-Species Fruit Detection.

Plant phenomics (Washington, D.C.)·2022
Same author

A Pruning Method for Deep Convolutional Network Based on Heat Map Generation Metrics.

Sensors (Basel, Switzerland)·2022
Same author

Easy domain adaptation method for filling the species gap in deep learning-based fruit detection.

Horticulture research·2021
Same author

Global Analysis the Potential Medicinal Substances of Shuangxia Decoction and the Process <i>In Vivo</i> via Mass Spectrometry Technology.

Frontiers in pharmacology·2021

Related Experiment Video

Updated: Nov 17, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
03:31

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

792

Asymmetric Adaptive Fusion in a Two-Stream Network for RGB-D Human Detection.

Wenli Zhang1, Xiang Guo1, Jiaqi Wang1

  • 1Faculty of Information Technology, Beijing University of Technology, Beijing 100124, China.

Sensors (Basel, Switzerland)
|February 12, 2021
PubMed
Summary
This summary is machine-generated.

This paper introduces a new computer vision model designed to identify people in indoor environments using both color and depth images. By using a specialized network structure, the system effectively handles common difficulties like poor lighting, blocked views, and varied body positions. The authors also provide a new dataset to test these capabilities, showing their approach performs better than current industry standards.

Keywords:
RGB-D human detectionadaptive fusionasymmetricmultimodaltwo-stream networksmart buildingsfeature pyramidadaptive channel weightingindoor surveillance

Frequently Asked Questions

More Related Videos

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
04:48

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

650

Related Experiment Videos

Last Updated: Nov 17, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
03:31

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

792
Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique
04:48

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

650

Area of Science:

  • Computer vision research within RGB-D human detection
  • Artificial intelligence and machine learning applications

Background:

Indoor monitoring systems often struggle to identify individuals accurately when visual conditions are suboptimal. Prior research has shown that environmental factors like dim lighting frequently degrade detection accuracy in smart buildings. Occlusion remains a persistent hurdle that prevents reliable tracking of occupants in crowded spaces. That uncertainty drove the need for more robust computational architectures capable of processing diverse sensory inputs. No prior work had resolved how to balance high performance with reduced processing demands in dual-input systems. Existing frameworks often rely on heavy computational loads that limit their deployment in real-time security applications. This gap motivated the development of specialized networks that prioritize both efficiency and precision. Researchers continue to seek methods that maintain stability despite the complex poses encountered in daily human activity.

Purpose Of The Study:

This study aims to develop an asymmetric adaptive fusion two-stream network to improve the accuracy of identifying people in indoor environments. The researchers sought to address persistent challenges such as poor lighting, frequent occlusion, and varied body poses. Many existing detection systems fail to maintain reliability when faced with these common indoor visual obstacles. The authors identified a need for a framework that extracts person-specific features while minimizing computational overhead. They intended to create a more efficient alternative to standard two-stream architectures. By combining multiscale depth information, the team aimed to enhance the model's adaptability to targets of different sizes. They also sought to introduce a new dataset to provide a rigorous benchmark for evaluating detection performance. This work was motivated by the requirement for more robust and efficient surveillance solutions in smart building applications.

Main Methods:

The researchers designed an asymmetric adaptive fusion two-stream network to process color and depth image inputs simultaneously. Their approach involves constructing a depth feature pyramid that integrates contextual information across multiple scales. They implemented an adaptive channel weighting module to refine feature selection during the information fusion phase. The team curated a novel dataset, termed RGBD-human, to serve as the primary benchmark for their experiments. They compared the performance of their model against several established state-of-the-art detection frameworks. Evaluation metrics focused on the stability of the system under conditions of varying illumination and frequent object occlusion. The study utilized standard indoor scene imagery to simulate real-world smart building environments. This methodology ensures that the proposed network is tested against both simple and complex visual scenarios.

Main Results:

The proposed network consistently outperforms existing state-of-the-art methods in detecting individuals within indoor scenes. The model maintains stable performance even when subjects are partially hidden by other objects or environmental elements. Low illumination conditions do not significantly degrade the detection accuracy of the system compared to baseline models. The integration of multiscale depth features allows for precise identification of targets regardless of their physical size. Adaptive channel weighting successfully enhances the selection of relevant sensory information from both color and depth streams. The system effectively handles multiple body poses that typically cause failures in traditional detection architectures. Quantitative analysis on the RGBD-human dataset confirms the superiority of the asymmetric fusion approach. These results indicate that the network achieves a balance between computational efficiency and high detection reliability.

Conclusions:

The authors demonstrate that their proposed network architecture achieves superior detection accuracy compared to existing state-of-the-art models. This approach effectively mitigates performance drops caused by common environmental challenges like poor lighting and visual obstructions. The integration of multiscale depth information allows the system to adapt to targets of varying physical dimensions. By utilizing adaptive channel weighting, the model successfully prioritizes relevant features while discarding redundant sensory data. The introduced dataset provides a valuable resource for future benchmarking of similar computer vision tasks. These findings suggest that asymmetric fusion strategies offer a viable path toward more efficient and reliable indoor surveillance. The system maintains consistent detection capabilities even when subjects exhibit diverse or non-standard body postures. Future applications of this technology could enhance the reliability of automated security and smart building management systems.

The system employs an asymmetric adaptive fusion two-stream network. This architecture extracts person-specific depth and color features while utilizing an adaptive channel weighting module to prioritize information, which improves detection accuracy under challenging conditions like occlusion or low light compared to traditional symmetric models.

The researchers developed the RGBD-human dataset to evaluate their algorithm. This collection contains specific indoor scenes designed to test detection performance against existing benchmarks, providing a standardized environment that differs from previous public datasets used in earlier studies.

The authors constructed a depth feature pyramid by incorporating contextual information. This technical necessity allows the network to combine multiscale depth features, which is required to improve adaptability for targets of different sizes, unlike simpler architectures that lack multiscale processing capabilities.

The adaptive channel weighting module functions to weight RGB-D feature channels. This component plays a role in efficient feature selection and information complementation, ensuring the network focuses on the most informative data streams rather than treating all inputs with equal importance.

The researchers measured performance by testing the network against state-of-the-art methods. They observed that their model maintains stable detection rates under frequent occlusion, low illumination, and multiple poses, demonstrating higher robustness than the baseline approaches tested in the study.

The authors propose that their asymmetric fusion strategy reduces the complexity typically associated with two-stream networks. They claim this approach provides a more efficient alternative to standard architectures while simultaneously enhancing the ability to handle complex indoor visual scenarios.