Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

A bio-inspired customizable mechanical central pattern generator enables one-to-many scalable pneumatic control.

Communications engineering·2026

Same author

Comprehensive safety assessment of Bt toxins Cry1Ac or Cry2Ae on the non-target insect Hermetia illucens, a natural waste recycler.

Ecotoxicology and environmental safety·2026

Same author

Noncollinear ferrielectricity in a van der Waals crystal.

Nature communications·2026

Same author

Muscle regeneration on a chip: exercise-induced microtrauma and optimal mechanical stimulation regimen.

Lab on a chip·2026

Same author

Quantitative Characterization of Surface Wettability and Interfacial Energy of Newtonian Fluids on PDMS with Engineered Roughness.

Langmuir : the ACS journal of surfaces and colloids·2025

Same author

Self-Powered Multimodal Tactile Sensing Enabled by Hybrid Triboelectric and Magnetoelastic Mechanisms.

Cyborg and bionic systems (Washington, D.C.)·2025

Search research articles

Related Experiment Video

Updated: Jun 28, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

Multi-Task Foreground-Aware Network with Depth Completion for Enhanced RGB-D Fusion Object Detection Based on

Jiasheng Pan¹, Songyi Zhong^2,3, Tao Yue²

¹School of Computer Engineering and Science, Shanghai University, No. 99 Shangda Road, Shanghai 200444, China.

Sensors (Basel, Switzerland)

|April 13, 2024

Summary

This study introduces a Transformer-based neural network for enhanced autonomous driving perception. The model improves object detection by fusing LiDAR and camera data, especially for small and distant targets.

Keywords:

Transformer YOLO depth completion multi-source feature fusion point cloud data

More Related Videos

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

Published on: April 21, 2023

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

Related Experiment Videos

Last Updated: Jun 28, 2025

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Author Spotlight: Enhancement of Salient Object Detection for Smart Grid Applications

Published on: December 15, 2023

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images

Published on: April 21, 2023

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Swin-PSAxialNet: An Efficient Multi-Organ Segmentation Technique

Published on: July 5, 2024

Area of Science:

Computer Vision
Robotics
Artificial Intelligence

Background:

Autonomous driving systems rely on sensor fusion, primarily LiDAR and cameras, for target recognition.
Traditional methods struggle with sparse LiDAR data, hindering detection of small or distant objects.

Purpose of the Study:

To develop a multi-task parallel neural network for simultaneous depth completion and object detection.
To improve the fusion of LiDAR and camera data for more robust autonomous driving perception.

Main Methods:

A Transformer-based multi-task parallel neural network was designed.
Redesigned loss functions to minimize environmental noise in depth completion.
Introduced a novel fusion module to enhance foreground-background perception.

Main Results:

The network effectively completes LiDAR point clouds using RGB pixel correlations, addressing feature mismatches.
Achieved significant performance improvements: 4.78% for cars, 8.93% for pedestrians, and 15.54% for cyclists.
Demonstrated a processing speed of 38 frames per second (fps), indicating efficiency.

Conclusions:

The proposed method enhances object detection, particularly for challenging targets, by effectively fusing multi-sensor data.
The network's ability to perform depth completion and object detection simultaneously offers a feasible and efficient solution for autonomous driving.