用CLIP和变压器网络进行语义增强功能提取,用于检测驾驶员疲劳
Zhen Gao1, Xiaowen Chen1, Jingning Xu1,2
1School of Computer Science and Technology, Tongji University, Shanghai 201804, China.
Sensors (Basel, Switzerland)
|January 8, 2025
概括
这项研究介绍了CT-Net,这是商业司机的新疲劳检测模型. CT-Net使用CLIP和变压器架构来显著提高识别昏昏欲睡驾驶的准确性,提高道路安全.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 运输安全运输安全
背景情况:
- 昏昏欲睡的驾驶是商用车辆事故的主要原因之一.
- 目前的疲劳检测模型在特征提取和网络优化方面遇到了困难.
- 深度神经网络通常用于从视频数据中分析驾驶员疲劳.
研究的目的:
- 率先使用CLIP (对比性语言图像预训) 进行疲劳检测.
- 开发一种新的网络架构,CT-Net (CLIP-Transformer Network),用于增强疲劳分析.
- 提高在商用车辆中检测昏昏欲睡驾驶的准确性和效率.
主要方法:
- 使用CLIP模型进行驾驶员视频数据预训练.
- 采用变压器架构从视频序列中提取复杂的长期时间特征.
- 开发了CT-Net (CLIP-变压器网络) 集成CLIP和变压器组件.
主要成果:
- CT-Net实现了曲线下的面积 (AUC) 为0.892.2.
- 与CNN-LSTM (卷积神经网络-长期短期记忆) 模型相比,证明了36%的准确性改进.
- 与ImageNet预训练相比,CLIP预训练提高了AUC7%,与LSTM相比,变压器提高了AUC4%.
结论:
- CT-Net模型代表了对疲劳检测的最先进的方法.
- CLIP和变压器架构有效地解决了特征提取和时间依赖模型中的挑战.
- 拟议的方法在商用车辆的昏昏欲睡驾驶检测方面取得了重大进展.
相关概念视频
01:18Clipper Circuit
A clipper circuit is a fundamental wave-shaping device that harnesses the unique properties of diodes to alter and control waveform characteristics. This technology is widely used in electronic devices, especially in television and radar communication systems, where it enhances waveform modulation in both transmitters and receivers.
The operation of a clipper circuit can be exemplified by analyzing a dual-clipper configuration setup that integrates two ideal diodes, each paired with a biasing...
The operation of a clipper circuit can be exemplified by analyzing a dual-clipper configuration setup that integrates two ideal diodes, each paired with a biasing...
01:14Clamper Circuit
A clamper circuit, also known as a DC restorer, represents a specialized variant of the rectifier circuit, notable for its method of taking the output across the diode rather than the capacitor. This configuration lends to several distinctive applications, particularly in handling square wave inputs.
Within this circuit, the diode's orientation prompts the capacitor to charge up to the level of the most negative peak of the input signal. Upon reaching this state, the diode ceases to conduct,...
Within this circuit, the diode's orientation prompts the capacitor to charge up to the level of the most negative peak of the input signal. Upon reaching this state, the diode ceases to conduct,...