语音的原始的视听整合
Robert E Remez1, Kathryn R Dubowski2, Daria F Ferro3
1Department of Psychology and Program in Cognitive Science, Barnard College, Columbia University, 3009 Broadway, New York, NY, 10027-6598, USA. remez@columbia.edu.
Attention, perception & psychophysics
|March 7, 2025
概括
视听感官集成使难以理解的语言变得可理解. 这一过程对于语音感知至关重要,它依赖于视觉和声音之间的早期,非语音整合,即使有不完美的信号.
科学领域:
- 认知科学 认知科学
- 听觉感知是一种听觉感知.
- 视觉感知 视觉感知 视觉感知
背景情况:
- 语音感知通常依赖于听觉和视觉线索.
- 了解大脑如何整合来自不同感官的信息是认知科学的关键.
研究的目的:
- 研究语音感知中的视听感官整合机制.
- 确定语音和非语音信息在这个整合过程中的作用.
主要方法:
- 呈现难以理解的视觉语言与同步的,难以理解的声学侧面.
- 在不同同步和感觉流领先滞后的条件下测试可理解性.
- 分析单模和双模 Gestalt 原则的贡献.
主要成果:
- 视听集成使得语音可理解,展示了强大的感官融合.
- 整合发生了即使没有解决单个模式的语言细节.
- 整合仍然存在,尽管失同,特别是当视觉输入之前的听觉输入.
结论:
- 早期,非音声感官整合在视听语音感知中发挥着重要作用.
- 感官输入的时间动态极大地影响了视听语言的可理解性.
- 即使使用非自然的听觉元件,也可以实现视听连贯性,突出显示大脑的整合能力.
相关概念视频
Visual System
468
Light enters the eye through the cornea, a transparent, dome-shaped surface covering the surface of the eyeball that helps to direct and focus incoming light. This light is then channeled toward the pupil, an adjustable opening whose size is controlled by the iris. The iris, a pigmented muscle, regulates the amount of light entering the eye by contracting or dilating the pupil, thereby ensuring optimal light levels for clear vision.
Once through the pupil, the light passes through the lens, a...
Once through the pupil, the light passes through the lens, a...
468
Higher Mental Functions of the Brain: Language
706
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
706
Auditory Pathway
4.6K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
4.6K
Hearing
51.7K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
51.7K
Motor and Sensory Areas of the Cortex
2.7K
The cerebral cortex, the brain's outermost layer, is pivotal in processing complex cognitive tasks, emotions, and various sensory inputs and executing voluntary motor activities. This intricate structure is divided into three primary functional areas: the motor areas, sensory areas, and association areas.
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor...
Motor Areas
The motor areas located in the frontal lobe are central to controlling voluntary movements. This region is further subdivided into the primary motor cortex and the premotor...
2.7K
Vision
52.9K
Vision is the result of light being detected and transduced into neural signals by the retina of the eye. This information is then further analyzed and interpreted by the brain. First, light enters the front of the eye and is focused by the cornea and lens onto the retina—a thin sheet of neural tissue lining the back of the eye. Because of refraction through the convex lens of the eye, images are projected onto the retina upside-down and reversed.
52.9K


