基于音乐的公民科学科学:视觉如何影响听觉
Daniel Bedoya1, Paul Lascabettes2, Lawrence Fyfe3
1Laboratoire de Mécanique des Structures et des Systèmes Couplés (LMSSC), Conservatoire National des Arts et Métiers (CNAM), Paris, France.
PloS one
|September 10, 2025
概括
通过结合音频和视觉输入来增强音乐注释的公民科学. 视觉图像有助于识别广的音乐结构,而音频显示更细微的细节,提高数据质量.
科学领域:
- 音乐信息检索 音乐信息检索
- 公民科学 公民科学
- 人与计算机的交互
背景情况:
- 公民科学项目通常依赖于视觉注释任务.
- 音乐结构注释对于音乐信息检索和治疗等应用至关重要.
- 视听输入对单模输入对音乐注释质量的影响尚不清楚.
研究的目的:
- 调查不同感官输入 (音频,视觉,视听) 对公民科学家音乐结构细分的准确性的影响.
- 为了比较单模 (视觉或音频) 与跨模 (视听) 输入对音乐注释的有效性.
主要方法:
- 参与者在不同的视听条件下对贝多芬32首小调变奏曲的音乐细分界限进行了注释.
- 使用边界信誉配置文件可视化了细分边界.
- 用不平衡的最佳运输距离和F-测量来评估注释质量,与跨模态黄金标准进行比较.
主要成果:
- 仅视觉输入产生的注释比仅音频输入更接近视听黄金标准.
- 视觉输入增强了全球细分的清晰度,由更大的边界信誉档案峰值表明.
- 音频输入对于辨别微妙的结构细微差别和解决差异更有效.
结论:
- 视听输入作为认知支架,改善公民科学音乐注释.
- 视觉线索对于识别大规模的音乐结构是有益的.
- 音频输入对于捕捉复杂的结构细节和微调注释至关重要.
相关概念视频
Auditory Perception
1.0K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.0K
Perceiving Loudness, Pitch, and Location
943
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
943
Perception of Sound Waves
5.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
5.4K
Hearing
56.6K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
56.6K
Factors Affecting Perception
2.7K
Perception is influenced by perceptual set, context, motivation, and emotion. Perceptual set, or perceptual expectancy, refers to the tendency to perceive things in a particular way, influenced by previous experiences and expectations. This phenomenon affects the interpretation of stimuli, creating a set of mental tendencies and assumptions that impact sensory perceptions of sound, taste, touch, and sight.
An illustrative example of a perceptual set is the scenario where an airline pilot told...
An illustrative example of a perceptual set is the scenario where an airline pilot told...
2.7K
Gene-Environment Interactions
1.1K
Gene expression is a dynamic process that is significantly influenced by environmental factors. This interaction underlies the complex nature of biological development and the phenotypic differences observed among individuals, even among those with identical genetic makeups. Factors such as radiation, temperature, behavior, nutrition, and stress play pivotal roles in determining how genes are expressed. The concept of the reaction range is central to understanding this interaction. It posits...
1.1K


