一种静态手语识别方法,增强了自我注意机制
Yongxin Wang1, He Jiang1, Yutong Sun2
1School of Measurement and Control Technology and Communication Engineering, Harbin University of Science and Technology, Harbin 150080, China.
Sensors (Basel, Switzerland)
|November 9, 2024
概括
这项研究引入了一种使用自我注意机制的新静态手语识别方法. 它实现了高精度和稳定性,即使在非标准的手势和噪音下,也有利于各种用户.
科学领域:
- 计算机科学 计算机科学
- 人工智能的人工智能
- 人与计算机的交互
背景情况:
- 由于用户的多样性,可穿戴设备在静态手语识别准确度,抗噪声和强度方面面临挑战.
- 现有的方法与手势执行和环境噪音的变化作斗争.
研究的目的:
- 开发一种新的静态手语识别方法,以提高对不同用户的准确性和稳定性.
- 为了提高手语识别系统在现实世界,可变条件下的性能.
主要方法:
- 使用自我注意机制来突出手势分类的关键特征.
- 卷积神经网络 (CNN) 用于特征提取和分类.
- 该方法集成了一个权重函数,以关注关键的手语特征.
主要成果:
- 在标准的36个手势的美国手语数据集上实现了99.52%的平均准确性.
- 在角偏差条件下表现出强大的性能 (98.63%在±9°,86.33%在±18°).
- 在静态手语识别的抗噪力和稳定性方面优于现有方法.
结论:
- 提出的自我注意力增强方法显著改善了静态手语识别.
- 该系统表现出优越的抗噪力和稳固性,使其适合各种用户群体.
- 这种方法为更容易获得和可靠的手语通信技术提供了一个有希望的解决方案.
相关概念视频
Nonconscious Mimicry
3.6K
Nonconscious mimicry occurs when individuals alter their mannerisms to match the behaviors and expressions of those nearby, without intention.
3.6K
Strategies of Self-Presentation II: Self-Verification
274
Self-verification is a fundamental psychological drive wherein individuals seek affirmation of their self-concept from others, striving for consistency between their internal self-view and external perceptions. This drive operates even when the self-concept is negative, influencing interpersonal behavior and feedback preferences in complex and often counterintuitive ways. Unlike the self-enhancement motive, which seeks positive evaluations, self-verification prioritizes coherence and...
274
Strategies of Self-Presentation III: Self-Monitoring
436
Self-monitoring is a central construct in understanding individual differences in self-presentation strategies across social contexts. It refers to how individuals observe, regulate, and control their expressive behavior and self-presentation following situational cues. Self-monitoring reflects a person's sensitivity to social appropriateness and willingness to adapt behavior to fit varying interpersonal demands.High vs. Low Self-Monitoring IndividualsIndividuals high in self-monitoring are...
436
Self-Awareness and Its Effects
416
Self-awareness is a psychological state in which the individual becomes the focal point of their attention. This inward focus transforms the self into an object of contemplation and assessment, influencing how individuals perceive their actions and their alignment with personal and societal standards.Triggers and Contexts for Self-AwarenessSelf-awareness can be activated by external stimuli that make individuals visually or audibly aware of themselves, such as mirrors, cameras, or recordings.
416
Automatic Processing and Automatic Social Behavior
376
Automatic processing refers to the cognitive operations that occur without conscious intent or awareness, playing a fundamental role in shaping social cognition and behavior. These processes enable individuals to navigate complex social environments efficiently by relying on mental shortcuts and pre-existing knowledge structures known as schemas. One of the most influential mechanisms underlying automatic processing is priming, which subtly activates mental representations through exposure to...
376
Non-Verbal Cues
774
Non-verbal communication extends beyond gestures and facial expressions to include vocal elements known as paralanguage. Paralanguage consists of non-verbal vocal cues such as pitch, loudness, speech rate, pauses, and non-verbal vocalizations like laughter, sighs, and moans. These elements not only accompany speech but also provide critical emotional and contextual information.The Role of Paralanguage in CommunicationParalanguage adds depth to spoken language by conveying emotions and...
774


