Jove
Visualize
联系我们
JoVE
x logofacebook logolinkedin logoyoutube logo
关于 JoVE
概览领导团队博客JoVE 帮助中心
作者
出版流程编辑委员会范围与政策同行评审常见问题投稿
图书馆员
用户评价订阅访问资源图书馆顾问委员会常见问题
研究
JoVE JournalMethods CollectionsJoVE Encyclopedia of Experiments存档
教育
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab Manual教师资源中心教师网站
使用条款与条件
隐私政策
政策

相关概念视频

Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

您也可能阅读

相关文章

通过共同作者、期刊和引用图与本文相关的文章。

排序
Same author

Event-Based Optical Flow via Transforming Into Motion-Dependent View.

IEEE transactions on image processing : a publication of the IEEE Signal Processing Society·2024
Same author

Event-based asynchronous HDR imaging by temporal incident light modulation.

Optics express·2024
Same author

The Traditional Chinese Medicine Baicalein Potently Inhibits Gastric Cancer Cells.

Journal of Cancer·2016
Same author

Evidence for Inbreeding and Genetic Differentiation among Geographic Populations of the Saprophytic Mushroom Trogia venenata from Southwestern China.

PloS one·2016
Same author

The establishment of species-specific primers for the molecular identification of ten stored-product psocids based on ITS2 rDNA.

Scientific reports·2016
Same author

Evolution and prognosis of breast osteosarcoma: A case report.

Oncology letters·2016

相关实验视频

Updated: Jul 9, 2026

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
09:27

Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

Published on: October 13, 2018

9.9K

通过探索多粒度的时空线索来解决基于事件的唇读问题.

Ganchao Tan, Zengyu Wan, Yang Wang

    IEEE transactions on neural networks and learning systems
    |September 17, 2024
    PubMed
    概括

    这项研究引入了用于自动唇读 (ALR) 的事件摄像头,通过一种新的多谷物时空特征学习框架实现了卓越的性能. 新方法有效地处理事件数据,以准确识别单词.

    科学领域:

    • 计算机视觉 计算机视觉
    • 机器学习 机器学习
    • 生物医学工程 生物医学工程

    背景情况:

    • 自动唇读 (ALR) 识别了从唇部运动发言.
    • 传统相机对ALR有局限性,包括较低的时间分辨率和更高的数据冗余性.
    • 事件摄像机具有诸如高时间分辨率,减少数据冗余和更低功耗等优点.

    研究的目的:

    • 引入事件摄像头作为一种用于自动唇读 (ALR) 的新型传感器.
    • 提出一种新的多谷类时空特征学习框架,用于处理ALR中的事件数据.
    • 使用事件摄像机技术开发和评估一个有效的ALR系统.

    主要方法:

    • 事件数据被转换为多时间分辨率事件.
    • 一个多分支子网络从事件框架中学习细粒度的空间和时间特征.
    • 一个时间聚合子网络模拟事件流中的时间关系.
    • 收集了两个新的基于事件的唇读数据集 (DVS-Lip和DVS-LRW100).

    主要成果:

    • 拟议的框架成功地从微秒分辨率事件数据中学习细粒度的时空特征.
    • 该系统通过多分支方法整合了空间完整和时间细微的特征.

    更多相关视频

    P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation
    06:09

    P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

    Published on: September 8, 2023

    518
    Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
    05:48

    Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

    Published on: August 9, 2024

    1.4K

    相关实验视频

    Last Updated: Jul 9, 2026

    Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language
    09:27

    Using Eye Movements Recorded in the Visual World Paradigm to Explore the Online Processing of Spoken Language

    Published on: October 13, 2018

    9.9K
    P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation
    06:09

    P300-Based Brain-Computer Interface Speller Performance Estimation with Classifier-Based Latency Estimation

    Published on: September 8, 2023

    518
    Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception
    05:48

    Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

    Published on: August 9, 2024

    1.4K
  • 实验结果表明,拟议的模型优于最新的基于事件的动作识别和基于视频的唇读模型.
  • 收集的数据集有助于进一步研究基于事件的唇读.

    • 结论:

    • 活动摄像头为自动唇读应用提供了显著的优势.
    • 新的多粒度时空特征学习框架对使用事件数据的ALR有效.
    • 拟议的方法证明了基于事件的唇阅读的最先进性能.