你描述,我们存档:一个丰富的音频描述数据集
Charity Pitcher-Cooper1, Manali Seth2, Benjamin Kao2
1Smith-Kettlewell Eye Research Institute.
概括
你描述,我们存档 (YuWA) 数据集为人工智能和机器学习研究提供了有价值的音频描述数据. 这个系列支持视频理解和视觉障碍者可访问性的进步.
科学领域:
- 计算机科学 计算机科学
- 人与计算机的交互
- 语言学的语言学.
背景情况:
- 你描述,我们存档 (YuWA) 数据集是一个独特的音频描述 (AD) 数据集合.
- 它是通过旧金山州立大学和史密斯-凯特尔韦尔眼科研究所的合作编制的.
- 数据涵盖2013-2022年,通过YouDescribe平台在全球获取.
研究的目的:
- 为了展示"你描述了,我们存档了" (YuWA) 数据集,用于研究应用.
- 为突出众多AI和计算语言学任务群众来源的音频描述的实用性.
- 为研究视频理解和可访问性提供丰富的资源.
主要方法:
- 尤瓦数据集包括通过YouDescribe平台收集的音频描述数据.
- YouDescribe为YouTube视频提供用户生成的音频描述,涉及志愿者描述者和盲人和视障 (BVI) 用户的请求.
- 数据包括音频描述曲目,描述者和观众的元数据以及收集时间表.
主要成果:
- 在YouDescribe平台上,已有3000多名志愿描述者参与,创造了5500多个音频描述视频.
- 尤瓦数据集包含2013-2022年全球音频描述数据.
- 该数据集在https://youdescribe.org/.上公开提供.
结论:
- 尤瓦数据集为人工智能,机器学习和自然语言处理领域的研究提供了巨大的潜力.
- 它是推进音频描述技术和视频语言基础的宝贵资源.
- 该数据集支持跨学科的研究,涵盖计算机科学,可访问性和社会语言学.
相关概念视频
Sound Intensity
4.0K
The loudness of a sound source is related to how energetically the source is vibrating, consequently making the molecules of the propagation medium vibrate. To measure the loudness of a source, the physical quantity of interest is the intensity. This is defined as the energy emitted per unit of time per unit of area perpendicular to the sound wave's propagation direction. Since the total energy is greater if the source vibrates for a longer duration and over a larger area, dividing the...
4.0K
Sound Intensity Level
4.2K
Humans perceive sound by hearing. The human ear helps sound waves reach the brain, which then interprets the waves and creates the perception of hearing. The loudness of the environment in which a person is located determines whether they can distinguish between different sound sources.
The human ear can perceive an extensive range of sound intensity, necessitating the use of the logarithmic scale to define a physical quantity—the intensity level. It is a ratio of two intensities and...
The human ear can perceive an extensive range of sound intensity, necessitating the use of the logarithmic scale to define a physical quantity—the intensity level. It is a ratio of two intensities and...
4.2K
Auditory Pathway
5.4K
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking...
5.4K
Sound as Pressure Waves
2.4K
Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
The pressure fluctuation depends on the difference in displacements between the successive points in the...
2.4K
Korotkoff Sounds
3.3K
Korotkoff sounds are the specific sounds heard while measuring blood pressure using a sphygmomanometer, typically with a stethoscope or a Doppler device. They are named after Russian physician Nikolai Korotkov, who first described them in 1905. These sounds correspond to turbulent blood flow in the artery as the blood pressure cuff is gradually released after inflation.
During blood pressure assessment, inflating the cuff 30 millimeters of mercury above the patient's systolic blood pressure...
During blood pressure assessment, inflating the cuff 30 millimeters of mercury above the patient's systolic blood pressure...
3.3K
Linear Approximation in Frequency Domain
89
Linear systems are characterized by two main properties: superposition and homogeneity. Superposition allows the response to multiple inputs to be the sum of the responses to each individual input. Homogeneity ensures that scaling an input by a scalar results in the response being scaled by the same scalar.
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
In contrast, nonlinear systems do not inherently possess these properties. However, for small deviations around an operating point, a nonlinear system can often be approximated as linear....
89


