语音学习双模训练的好处 语音学习双模训练的好处
Serena Zadoorian1, Lawrence D Rosenblum1
1Department of Psychology, University of California, Riverside, CA 92521, USA.
Brain sciences
|September 28, 2023
概括
学习声音更容易,当你看到说话的人.
科学领域:
- 听觉感知是一种听觉感知.
- 语音处理 语音处理
- 多模式学习是多模式学习.
背景情况:
- 说话者识别依赖于语音品质,如基本频率和呼吸度.
- 演讲者识别还利用口音风格,可视和听觉观察.
- 之前的研究表明,当声音与视觉面部暗示配对时,语音识别得到了改善.
研究的目的:
- 调查面部暗示是否通过说话者特定的articulatory或nonarticulatory信息促进语音学习.
- 确定视觉面部信息对声音听觉学习的贡献.
主要方法:
- 参与者在不同的条件下学习了十个说话者的声音:单独的声音,表达面孔的声音,静态面孔的声音或与孤立的表达口的声音.
- 语音识别的测试是独立于训练模式进行的.
- 该研究比较了不同视觉暗示条件的语音识别准确性.
主要成果:
- 与表达面孔一起学习的声音比单独学习的声音更好地被识别.
- 与单独学习的声音相比,静态的面孔和孤立的口腔并没有显著改善语音学习.
- 看到表达的面孔增强了随后的语音识别.
结论:
- 面部暗示,特别是面部可见的关节,显著促进语音学习.
- 这项研究强调了动态面部信息在多模式语音感知中的重要性.
- 来自全脸的视觉关节信息,而不仅仅是嘴巴,有助于语音记忆的巩固.
相关概念视频
Air-entraining Agents
92
Air-entraining agents improve the durability and workability of concrete in climates with frequent freezing and thawing. These agents prevent cracks by introducing small air bubbles into the mix, creating spaces accommodating water expansion when temperatures drop. The air-entraining agents lower the surface tension of water, forming stable, small air bubbles. This method is more effective than having accidental large voids, as the intentional, smaller, and evenly distributed air voids improve...
92
Auditory Perception
357
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
357
Facial Feedback Hypothesis
179
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
179
Perceiving Loudness, Pitch, and Location
233
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
233
Double Resonance Techniques: Overview
240
Double resonance techniques in Nuclear Magnetic Resonance (NMR) spectroscopy involve the simultaneous application of two different frequencies or radiofrequency pulses to manipulate and observe two distinct nuclear spins. One important application of double resonance is spin decoupling, which selectively suppresses coupling with one type of nucleus while observing the NMR signal from another nucleus, simplifying the spectrum and enhancing resolution.
Spin decoupling is usually achieved by...
Spin decoupling is usually achieved by...
240
Effects of feedback
588
Feedback in control systems plays a critical role in shaping various operational parameters, extending beyond simple error reduction to influence stability, bandwidth, gain, impedance, and sensitivity. Understanding these effects requires examining a basic feedback system characterized by defined input, output, error, and feedback signals.
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
Feedback significantly modifies the gain of a control system. The gain of a system without feedback is altered by a factor of one plus GH, where G represents...
588


