Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

What is a Sensory System?01:31

What is a Sensory System?

89.6K
Sensory systems detect stimuli—such as light and sound waves—and transduce them into neural signals that can be interpreted by the nervous system. In addition to external stimuli detected by the senses, some sensory systems detect internal stimuli—such as the proprioceptors in muscles and tendons that send feedback about limb position.
89.6K
Light Acquisition02:16

Light Acquisition

8.0K
In order to produce glucose, plants need to capture sufficient light energy. Many modern plants have evolved leaves specialized for light acquisition. Leaves can be only millimeters in width or tens of meters wide, depending on the environment. Due to competition for sunlight, evolution has driven the evolution of increasingly larger leaves and taller plants, to avoid shading by their neighbors with contaminant elaboration of root architecture and mechanisms to transport water and nutrients.
8.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A Co-Operative Perception System for Collision Avoidance Using C-V2X and Client-Server-Based Object Detection.

Sensors (Basel, Switzerland)·2025
Same author

An Optimized DNN Model for Real-Time Inferencing on an Embedded Device.

Sensors (Basel, Switzerland)·2023
Same author

A Sensor Fused Rear Cross Traffic Detection System Using Transfer Learning.

Sensors (Basel, Switzerland)·2021
See all related articles

Related Experiment Video

Updated: Apr 30, 2026

Design and Analysis for Fall Detection System Simplification
08:05

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

10.6K

Sensor-Fused Nighttime System for Enhanced Pedestrian Detection in ADAS and Autonomous Vehicles.

Jungme Park1, Bharath Kumar Thota1, Karthik Somashekar1

  • 1College of Engineering, Kettering University, Flint, MI 48504, USA.

Sensors (Basel, Switzerland)
|July 27, 2024
PubMed
Summary

This study introduces a sensor-fused system for nighttime pedestrian detection, combining thermal and RGB cameras. The developed Deep Neural Network (DNN) model significantly improves detection accuracy and speed for safer autonomous driving.

Keywords:
ADASDeep Neural Networkembedded devicesimage alignmentnighttime object detectionsensor-fusiontransfer learning

More Related Videos

Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research
07:15

Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research

Published on: December 18, 2020

4.5K
Evaluating the Effect of Roadside Parking on a Dual-Direction Urban Street
14:55

Evaluating the Effect of Roadside Parking on a Dual-Direction Urban Street

Published on: January 20, 2023

3.3K

Related Experiment Videos

Last Updated: Apr 30, 2026

Design and Analysis for Fall Detection System Simplification
08:05

Design and Analysis for Fall Detection System Simplification

Published on: April 6, 2020

10.6K
Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research
07:15

Tactile Vibrating Toolkit and Driving Simulation Platform for Driving-Related Research

Published on: December 18, 2020

4.5K
Evaluating the Effect of Roadside Parking on a Dual-Direction Urban Street
14:55

Evaluating the Effect of Roadside Parking on a Dual-Direction Urban Street

Published on: January 20, 2023

3.3K

Area of Science:

  • Computer Vision
  • Robotics
  • Automotive Engineering

Background:

  • Nighttime road safety is challenged by poor visibility, increasing the risk for vulnerable road users.
  • Existing environmental perception systems struggle with accurate and timely detection of pedestrians in low-light conditions.

Purpose of the Study:

  • To develop and evaluate a sensor-fused nighttime environmental perception system for enhanced vulnerable road user detection.
  • To improve the accuracy and reduce the latency of pedestrian detection systems for Advanced Driver Assistance Systems (ADASs) and autonomous vehicles.

Main Methods:

  • Integration of thermal and RGB camera data using a novel alignment algorithm for effective sensor fusion.
  • Development of Deep Neural Network (DNN) models, including three fusion techniques and two single-sensor models, trained on a dataset of 32,000 nighttime image pairs.
  • Optimization of the best-performing late-fusion model for real-time inferencing on embedded edge computing devices.

Main Results:

  • Sensor-fused models demonstrated superior performance compared to single-sensor (RGB or thermal) models.
  • The optimized late-fusion model achieved 33 frames per second (fps) on an embedded device, an 83.33% improvement in inference speed.
  • The system achieved a balance between high accuracy and rapid response time for nighttime pedestrian detection.

Conclusions:

  • Sensor fusion of thermal and RGB data significantly enhances nighttime environmental perception systems.
  • The developed DNN system offers a viable solution for real-time, accurate pedestrian detection, crucial for ADASs and autonomous driving.
  • This research contributes to improving road safety by reducing nighttime accidents involving vulnerable road users.