LAVRF:通过轻量级注意力VGG16与随机森林的手语识别
Edmond Li Ren Ewe1, Chin Poo Lee2, Kian Ming Lim2
1Faculty of Engineering and Technology, Multimedia University, Melaka, Malaysia.
PloS one
|April 4, 2024
概括
一个新的轻量级注意力VGG16随机森林 (LAVRF) 模型增强了手语识别. 这个模型在多个数据集上达到99%以上的准确性,改善了手势细节的捕捉.
科学领域:
- 计算机视觉 计算机视觉
- 机器学习 机器学习
- 人与计算机的交互
背景情况:
- 由于复杂的手势和细微细节,手语识别面临挑战.
- 现有的方法在复杂的手势细微差别和数据复杂性方面扎.
研究的目的:
- 引入一个新的轻量级注意力VGG16随机森林 (LAVRF) 模型,以改进手语识别.
- 为了解决当前模型在捕捉详细的手势和处理复杂数据方面的局限性.
主要方法:
- 一个精简的VGG16架构与注意模块集成,用于集中图像区域分析.
- 整合了一个随机森林分类器,以对高维特征进行强大的处理,并减少过拟合.
- 使用Optuna和爬山进行超参数优化,以实现高效的配置发现.
主要成果:
- 在美国手语中,LAVRF模型的准确度达到了99.98%,在美国手语中使用数字时达到了99.90%,在美国手语中使用数字时达到了100%.
- 注意力机制通过关注相关的图像区域来增强表示学习.
- 随机森林分类器证明了对噪音数据和减少差异的弹性.
结论:
- LAVRF模型为手语识别提供了一个高度准确和高效的解决方案.
- 注意引导VGG16和随机森林的组合有效地捕捉复杂的手语手势.
- 这种方法显著推进了手语识别和可访问性领域.
相关概念视频
01:22Force Classification
1.2K
Forces play a crucial role in the study of physics and engineering. They are essential in describing the motion, behavior, and equilibrium of objects in the physical world. Forces can be classified based on their origin, type, and direction of action.
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
1.2K
01:30Classification of Signals
456
In signal processing, signals are classified based on various characteristics: continuous-time versus discrete-time, periodic versus aperiodic, analog versus digital, and causal versus noncausal. Each category highlights distinct properties crucial for understanding and manipulating signals.
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
456