声学是足够的吗? 在自然场景中的听觉突出性上的语义效应
Sandeep Reddy Kothinti1, Mounya Elhilali1
1Department of Electrical and Computer Engineering, Center for Language and Speech Processing, The Johns Hopkins University, Baltimore, MD, United States.
Frontiers in psychology
|December 15, 2023
概括
听觉突出,声音如何吸引注意力,是由声学和语义因素共同塑造的. 这项研究表明,意义和上下文显著影响我们在自然声音景观中注意到的东西.
科学领域:
- 听觉感知是一种听觉感知.
- 认知心理学 认知心理学
- 声学场景分析 声学场景分析
背景情况:
- 听觉突出性吸引了人们的注意力,而不管听众的目标是什么.
- 以前的研究集中在声学线索上,忽视了语义影响.
- 自然场景对听觉突出性研究提出了复杂的挑战.
研究的目的:
- 调查声学,上下文和语义属性的相互作用在自然场景中的听觉突出.
- 在事件突出性方面区分低级声学与高级语义的作用.
- 探索时间背景对听觉突出感知的影响.
主要方法:
- 迪霍斯听力范式,前向和后向的音频演示.
- 群众来源的行为数据收集用于时间突出映射.
- 综合分析方法,结合声学配置文件和深度神经网络嵌入.
主要成果:
- 行为数据显示时间突出性地图的收和分歧.
- 语义和上下文线索显著驱动感知突出差异.
- 声学属性主要解释了突出感知中的高度对齐.
- 长期的背景对于辨别时间规律至关重要.
结论:
- 感知突出性来自于低级声学和高级语义属性之间的相互作用.
- 语义因素在听觉突出中发挥着关键作用,特别是在复杂的自然场景中.
- 这些发现提升了对听觉突出性的理解,并为音频分析模型提供了信息.
相关概念视频
Hearing
52.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.4K
Factors Affecting Perception
1.6K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
1.6K
Auditory Perception
341
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
341
Perception of Sound Waves
4.5K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.5K
Perceiving Loudness, Pitch, and Location
216
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
216
Auditory Pathway
5.4K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.4K


