Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Aberrations in Peripheral Blood Neuron-Specific Enolase Levels in Depression: A Systematic Review and Meta-Analysis.

Depression and anxiety·2026
Same author

IMATAC imputes single-cell ATAC-seq data by deep hierarchical network with denoising autoencoder.

Briefings in bioinformatics·2025
Same author

Letter to the editor regarding: "Slow gait speed is associated with frailty, activities of daily living and nutritional status in in-patient pulmonology patients."

Aging clinical and experimental research·2025
Same author

Letter to the Editor- "A machine-learning-derived online prediction model for depression risk in COPD patients: A retrospective cohort study from CHARLS".

Journal of affective disorders·2025
Same author

Association of dietary caffeine intake and metabolites in the urine of individuals with latent tuberculosis infection: a cross-sectional study.

BMC pulmonary medicine·2025
Same author

SurgRIPE challenge: Benchmark of surgical robot instrument pose estimation.

Medical image analysis·2025

Related Experiment Video

Updated: Jul 4, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
03:31

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

542

Multi-modal deep learning networks for RGB-D pavement waste detection and recognition.

Yangke Li1, Xinman Zhang1

  • 1School of Automation Science and Engineering, Faculty of Electronic and Information Engineering, Xi'an Jiaotong University, Xi'an 710049, Shaanxi, China.

Waste Management (New York, N.Y.)
|February 7, 2024
PubMed
Summary

This study introduces a new multi-modal learning approach for detecting and recognizing pavement waste using RGB and depth images. The proposed MM-Net significantly improves waste management efficiency for intelligent cleaning robots.

Keywords:
Computer visionDeep neural networkMulti-modal learningWaste detectionWaste recognition

More Related Videos

Deep Neural Networks for Image-Based Dietary Assessment
13:19

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

9.2K
Author Spotlight: AI-Driven Trypanosome Species Detection from Microscopic Images
08:20

Author Spotlight: AI-Driven Trypanosome Species Detection from Microscopic Images

Published on: October 27, 2023

1.5K

Related Experiment Videos

Last Updated: Jul 4, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications
03:31

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

542
Deep Neural Networks for Image-Based Dietary Assessment
13:19

Deep Neural Networks for Image-Based Dietary Assessment

Published on: March 13, 2021

9.2K
Author Spotlight: AI-Driven Trypanosome Species Detection from Microscopic Images
08:20

Author Spotlight: AI-Driven Trypanosome Species Detection from Microscopic Images

Published on: October 27, 2023

1.5K

Area of Science:

  • Computer Science
  • Artificial Intelligence
  • Robotics

Background:

  • Current pavement waste management relies on inefficient manual labor.
  • Existing deep learning methods for waste detection are limited by RGB image data.

Purpose of the Study:

  • To develop an efficient multi-modal learning solution for pavement waste detection and recognition.
  • To address the limitations of RGB-only methods by incorporating depth information.

Main Methods:

  • Construction of the high-quality outdoor pavement waste dataset (OPWaste) with color and depth images.
  • Development of a novel multi-modal multi-scale network (MM-Net) incorporating multi-scale refinement (MRM) and interaction (MIM) modules.
  • Exploration and comparison of six different multi-modal fusion techniques.

Main Results:

  • MM-Net, utilizing an image addition fusion method, achieved state-of-the-art performance.
  • The model reached 97.3% on mAP0.5 and 84.4% on AR metrics in experimental evaluations.
  • Comparative experiments demonstrated the superiority of MM-Net over other deep learning models.

Conclusions:

  • Multi-modal learning is crucial for advancing intelligent waste recycling systems.
  • The proposed MM-Net offers a promising solution for automatic outdoor waste management using intelligent cleaning robots.