通过多头卷积神经网络,使用图像和手标志的融合进行手语识别
Refat Khan Pathan1, Munmun Biswas2, Suraiya Yasmin3
1Department of Computing and Information Systems, School of Engineering and Technology, Sunway University, 47500, Bandar Sunway, Selangor, Malaysia.
Scientific reports
|October 9, 2023
概括
本研究提出了一种具有成本效益的人工智能技术,用于使用图像数据集识别美国手语 (ASL). 拟议的多头卷积神经网络实现了98.981%的准确性,帮助聋社会的沟通.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 标语识别 (SLR) 对于聋沟通至关重要.
- 以前的单反相机方法通常需要昂贵的硬件和大量的处理能力.
- 人工智能为SLR提供了更容易获得的方法.
研究的目的:
- 使用易于获得的图像数据开发一个具有成本效益的美国手语 (ASL) 识别系统.
- 通过利用人工智能和移动技术,克服传统SLR方法的局限性.
- 为了改善聋社区的人机通信.
主要方法:
- 使用"指拼写,A"数据集,包括24个ASL字母,复杂的背景.
- 实施了双层图像处理技术:全图像训练和手动地标提取.
- 开发和训练了一个多头卷积神经网络 (CNN) 模型.
- 员工数据的增强和动态学习率的降低,以防止过度拟合.
主要成果:
- 通过拟议的CNN模型实现了98.981%的高测试准确率.
- 证明了双层图像处理方法的有效性.
- 成功地从各种背景和颜色的图像中识别了ASL手势.
结论:
- 拟议的基于人工智能的技术为ASL识别提供了一种高效和具有成本效益的解决方案.
- 这项研究为为聋社会开发先进的人机通信工具铺平了道路.
- 该方法突出了使用标准移动技术来完成复杂的人工智能任务 (如手语识别) 的潜力.
相关概念视频
Association Areas of the Cortex
5.4K
Association areas are regions of the cerebral cortex that do not have a specific sensory or motor function. Instead, they integrate and interpret information from various sources to enable higher cognitive processes such as memory, learning, and decision-making. Some key association areas include the following:
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
Prefrontal Association Area: This area is located in the frontal lobe and is involved in planning, decision-making, and moderating social behavior. It connects with primary motor areas,...
5.4K
Prosopagnosia
188
Prosopagnosia, also known as face blindness, is the inability to recognize faces. In severe cases, individuals with prosopagnosia may not recognize close family members, including parents and spouses, by their faces. For instance, someone with prosopagnosia might walk past their child in a crowd, only realizing their mistake upon noticing their child's distinctive backpack or favorite jacket. Prosopagnosia specifically impairs facial recognition, while the recognition of other objects or...
188


