EEG and ECG-Based Multi-Sensor Fusion Computing for Real-Time Fatigue Driving Recognition Based on Feedback Mechanism
Ling Wang1, Fangjie Song1, Tie Hua Zhou1
1Department of Computer Science and Technology, School of Computer Science, Northeast Electric Power University, Jilin 132013, China.
Sensors (Basel, Switzerland)
|October 28, 2023
Summary
This study integrates multiple sensors to accurately detect driver fatigue and distraction, enhancing driving safety. The multi-sensor fusion approach shows strong performance in recognizing driver states to prevent accidents.
Area of Science:
- Road safety
- Human-computer interaction
- Biomedical engineering
Background:
- Traffic accidents are a major concern, with driver state (fatigue, distraction) being a key factor.
- Current driver monitoring systems use visual, physiological, or vehicle behavior analysis, but often lack comprehensive accuracy.
- Accurate driver state recognition is crucial for developing advanced driver-assistance systems (ADAS) and improving road safety.
Purpose of the Study:
- To develop and validate a multi-sensor fusion approach for enhanced driver state recognition.
- To improve the accuracy of detecting driver fatigue and distraction compared to single-method approaches.
- To lay the groundwork for future research in real-time driver monitoring and proactive safety interventions.
Main Methods:
- Utilized a multi-sensor fusion strategy combining physiological signals (electroencephalogram [EEG], electrocardiogram [ECG]), in-vehicle driver behavior monitoring (camera), and external vehicle position analysis (camera).
- Collected and analyzed data from various sensors to assess driver fatigue and distraction levels.
- Conducted experimental validations to evaluate the performance of the integrated multi-sensor system.
Main Results:
- The multi-sensor fusion approach demonstrated robust performance in accurately recognizing various driver states, including fatigue and distraction.
- Integration of physiological signals, in-vehicle behavior, and vehicle dynamics provided a more comprehensive assessment than individual methods.
- Experimental results confirmed the effectiveness of the proposed system in enhancing driver state detection capabilities.
Conclusions:
- The developed multi-sensor fusion system offers a promising solution for accurate driver state recognition.
- This research provides a strong foundation for advancing driver monitoring technologies and improving overall road safety.
- Future work can build upon this approach to create more sophisticated systems for real-time driver assistance and accident prevention.


