Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Auditory Perception01:17

Auditory Perception

1.0K
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
1.0K

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Generalisable artificial intelligence ECG trained on public data for outcome prediction after transcatheter aortic valve replacement.

Heart (British Cardiac Society)·2026
Same author

ATEdrug: A reliable human-in-the-loop annotation scheme for aspect term extraction and polarity detection in drug reviews.

PloS one·2026
Same author

Next-generation digital twin model with unobtrusive RF multi-sensing for AI-based human monitoring.

Scientific reports·2026
Same author

The First JenaValve Trilogy System Transcatheter Aortic Valve Replacement for Pure Severe Native Aortic Valve Regurgitation in Taiwan: A Case Report.

Acta Cardiologica Sinica·2026
Same author

Deep learning analysis for enhanced prediction of heat transfer in Maxwell hybrid nanofluids with non-Fourier law and radiation effects.

Scientific reports·2026
Same author

A novel deep semantic- and vision-based self-attention architecture for skin cancer classification.

Digital health·2026

相关实验视频

Updated: Jan 16, 2026

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
06:04

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages

Published on: March 24, 2023

756

利用自主监督的视听预训练模型,在耳植入物模拟中提高声编码语音可理解性.

Richard Lee Lai, Jen-Cheng Hou, I-Chun Chern

    IEEE transactions on bio-medical engineering
    |October 2, 2025
    PubMed
    概括
    此摘要是机器生成的。

    本研究介绍了基于自主监督学习的视听语音增强 (SSL-AVSE),以提高听力障碍者使用耳植入模拟器的语音理解. 通过整合视觉线索,SSL-AVSE显著提高了语音质量和可理解性.

    更多相关视频

    Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
    05:48

    Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

    Published on: August 9, 2024

    2.0K
    Synthetic, Multi-Layer, Self-Oscillating Vocal Fold Model Fabrication
    10:16

    Synthetic, Multi-Layer, Self-Oscillating Vocal Fold Model Fabrication

    Published on: December 2, 2011

    14.5K

    相关实验视频

    Last Updated: Jan 16, 2026

    Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
    06:04

    Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages

    Published on: March 24, 2023

    756
    Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
    05:48

    Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

    Published on: August 9, 2024

    2.0K
    Synthetic, Multi-Layer, Self-Oscillating Vocal Fold Model Fabrication
    10:16

    Synthetic, Multi-Layer, Self-Oscillating Vocal Fold Model Fabrication

    Published on: December 2, 2011

    14.5K

    科学领域:

    • 听力学 听力学是指听力学.
    • 语音处理 语音处理
    • 机器学习 机器学习

    背景情况:

    • 听力障碍在语音理解方面存在重大挑战,特别是在杂的环境中.
    • 耳植入物 (CIs) 旨在恢复听力,但可能与语音可理解性,特别是处理 (语音编码) 语音扎.
    • 视听语音增强 (AVSE) 通过利用视觉线索,如唇部运动,提供了一个潜在的解决方案.

    研究的目的:

    • 评估基于自主监督学习的新型视听语音增强 (SSL-AVSE) 框架的有效性,以改善耳植入物 (CI) 模拟中的语音编码语音可理解性.
    • 与现有方法相比,研究SSL-AVSE的性能.
    • 评估拟议模型的跨语言概括能力.

    主要方法:

    • 开发了SSL-AVSE框架,将视觉语音线索 (唇/嘴部运动) 与音频集成在一起.
    • 使用AV-HuBERT模型进行特征提取和双向LSTM进行改进.
    • 对台湾普通话语语音与视频 (TMSV) 数据集进行了实验.

    主要成果:

    • 客观指标显示了显著的改善:PESQ从1.43增加到1.67,STOI从0.70改善到0.74.
    • 与噪音基线相比,NCM得分增加了高达87.2%.
    • 主观听力测试显示,语音质量的最大提升为45.2%,单词理解率为51.9%.

    结论:

    • 在CI模拟中,SSL-AVSE在CI模拟中表现出优于AOSE和传统AVSE基线的性能.
    • 从统计学上显著的听力测试证实了SSL-AVSE的有效性.
    • 该模型表现出跨语言的概括性,尽管进行了英语预训练,但在普通话演讲中表现得很好,这突显了基础模型特征的稳定性.