一个音频超声波同步的舌头运动数据库,用于普通话话语
Yudong Yang1, Rongfeng Su1, Shaofeng Zhao2
1Guangdong-Hong Kong-Macao Joint Laboratory of Human-Machine Intelligence-Synergy Systems, Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China.
Scientific data
|April 11, 2025
概括
这项研究创建了一个大型的普通话语音数据集与同步超声波舌头图像和音频录音. 这种多式联络数据库有助于语音病理学研究和自动语音识别开发.
科学领域:
- 语音科学 语言科学
- 生物医学工程 生物医学工程
- 语言学的语言学.
背景情况:
- 超声波成像可视化舌头运动,用于语音研究和临床应用.
- 高质量的音频超声波数据集很少,这限制了进步.
研究的目的:
- 构建一个全面的多式联运普通话语音数据库.
- 支持语音病理学,语言学和自动语音识别方面的研究.
主要方法:
- 收集了来自43名健康说话者和11名失声症患者的同步超声波舌头图像和音频录音.
- 利用语音任务,包括元音,单音和句子.
- 采用定制头盔用于超声波探针稳定,以最大限度地减少头部运动干扰.
主要成果:
- 开发了一个22.31小时的多式联络普通话语音数据库.
- 集成超声波语言运动,音频和文本注释.
- 证明了数据库对各种语音相关应用的实用性.
结论:
- 创建的数据库解决了高质量的音频超声数据的稀缺问题.
- 这种资源对于推进自动语音识别和理解语音障碍是有价值的.
相关概念视频
The Auditory Ossicles
3.9K
The auditory ossicles of the middle ear transmit sounds from the air as vibrations to the fluid-filled cochlea. The auditory ossicles consist of two malleus (hammer) bones, two incus (anvil) bones, and two stapes (stirrups), one on each side. These bones develop during the fetal stage and are the ones to ossify first. They are fully mature at birth and do not grow afterward.
The aptly named stapes look very much like a stirrup. The three ossicles are unique to mammals, and each plays a role in...
The aptly named stapes look very much like a stirrup. The three ossicles are unique to mammals, and each plays a role in...
3.9K
Beats
1.6K
The study of music provides many examples of the superposition of waves and the constructive and destructive interference that occurs. Very few examples of music being performed consist of a single source playing a single frequency for an extended period of time. A single frequency of sound for an extended period might be monotonous to the point of irritation, similar to the unwanted drone of an aircraft engine or a loud fan. Music is pleasant and exciting due to mixing the changing frequencies...
1.6K
Heart Sounds
3.7K
Heart sounds are generated by the turbulence in blood flow due to the closing of heart valves. These sounds are best perceived slightly away from the valves, where the blood flow disseminates the sound.
Auscultation is the process of listening to these internal body sounds using a stethoscope. The heart produces four types of sounds, but only two—S1 and S2—can usually be heard with a stethoscope.
S1, also known as the "lub" sound, is caused by the closure of atrioventricular (A-V)...
Auscultation is the process of listening to these internal body sounds using a stethoscope. The heart produces four types of sounds, but only two—S1 and S2—can usually be heard with a stethoscope.
S1, also known as the "lub" sound, is caused by the closure of atrioventricular (A-V)...
3.7K
Ultrasound II: Endoscopic Ultrasound and FibroScan
1.3K
Endoscopic Ultrasound (EUS) and FibroScan are valuable diagnostic tools in gastroenterology and hepatology, each with specific applications and techniques.
Endoscopic Ultrasound (EUS):
Endoscopic Ultrasound (EUS):
1.3K
Air-entraining Agents
402
Air-entraining agents improve the durability and workability of concrete in climates with frequent freezing and thawing. These agents prevent cracks by introducing small air bubbles into the mix, creating spaces accommodating water expansion when temperatures drop. The air-entraining agents lower the surface tension of water, forming stable, small air bubbles. This method is more effective than having accidental large voids, as the intentional, smaller, and evenly distributed air voids improve...
402


