卷积块注意力模块-多模特-融合动作识别:使矿工能够识别不安全的动作
Yu Wang1, Xiaoqing Chen1, Jiaoqun Li1
1School of Mining Engineering, University of Science and Technology Liaoning, Anshan 114051, China.
Sensors (Basel, Switzerland)
|July 27, 2024
概括
这项研究引入了一种计算机视觉模型,用于识别不安全的矿工行为,大大提高了地下采矿的安全性. 开发的模型在实时检测危险行为方面实现了高准确度.
科学领域:
- 计算机视觉 计算机视觉
- 人工智能的人工智能
- 采矿安全工程 采矿安全工程
背景情况:
- 不安全的矿工行为是矿山事故的主要原因.
- 实时识别这些行动对于预防事故至关重要.
- 现有的计算机视觉方法需要改进,以便在采矿环境中进行准确的检测.
研究的目的:
- 开发一种先进的计算机视觉模型,用于准确和实时识别地下矿工执行的不安全操作.
- 通过整合注意力机制和多式联接,提高现有的动作识别模型的性能.
主要方法:
- 地下矿工不安全行动的构建 (UAUM) 数据集有十个行动类别.
- 使用空间和频域算法进行图像增强.
- 整合YOLOX对象检测和Lite-HRNet关键点检测,用于骨架数据提取.
- 开发了卷积块注意力模块-多式特征融合动作识别 (CBAM-MFFAR) 模型,结合了骨架 (CBAM-PoseC3D) 和RGB (CBAM-SlowOnly) 模式.
主要成果:
- 在NTU60 RGB+D数据集上,CBAM-MFFAR模型的准确度达到95.8%,在UAUM数据集上达到94.6%.
- 与CBAM-PoseC3D,PoseC3D,2S-AGCN和ST-GCN等现有模型相比,显著提高了准确性.
- 在现场试验中成功验证,准确地识别了真实采矿场的复杂和多重不安全行为.
结论:
- CBAM-MFFAR模型提供了一个强大的,准确的解决方案,用于实时识别地下采矿中的不安全行为.
- 多式联络方法和注意力机制显著提高了识别性能.
- 这项技术有可能大大改善安全协议,并减少采矿行业的事故.
相关概念视频
Association Areas of the Cortex
5.2K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.2K
Masking and Demasking Agents
2.4K
EDTA titrations may necessitate masking and demasking agents to temporarily protect a particular metal ion in a mixture from the EDTA reaction. These agents facilitate the sequential analysis of the metal ions by forming stable complexes with some—but not all—metal ions during certain steps.
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
There are many masking agents, such as cyanide, fluoride, triethanolamine, thiourea, and 2,3-bis(sulfanyl)propan-1-ol (formerly 2,3-dimercapto-1-propanol), with the masking agent chosen based on...
2.4K
Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
Multi-input and Multi-variable systems
105
Cruise control systems in cars are designed as multi-input systems to maintain a driver's desired speed while compensating for external disturbances such as changes in terrain. The block diagram for a cruise control system typically includes two main inputs: the desired speed set by the driver and any external disturbances, such as the incline of the road. By adjusting the engine throttle, the system maintains the vehicle's speed as close to the desired value as possible.
In the absence...
In the absence...
105
Fixed Action Patterns
15.9K
A fixed action pattern (FAP) is a specific, hard-wired sequence of behaviors that occurs in response to an external stimulus, called a sign stimulus. The behavior is “fixed” because it is essentially unchangeable—proceeding similarly across individuals of a species every time it occurs.
15.9K
Parallel Processing
149
The brain processes sensory information rapidly due to parallel processing, which involves sending data across multiple neural pathways at the same time. This method allows the brain to manage various sensory qualities, such as shapes, colors, movements, and locations, all concurrently. For instance, when observing a forest landscape, the brain simultaneously processes the movement of leaves, the shapes of trees, the depth between them, and the various shades of green. This enables a quick and...
149


