解码无声语音命令从发音运动通过柔软的磁性皮肤和机器学习
Penghao Dong1, Yizong Li1, Si Chen1
1Department of Mechanical Engineering, Stony Brook University, Stony Brook, New York 11794, USA. shanshan.yao@stonybrook.edu.
Materials horizons
|September 26, 2023
概括
这项研究引入了一种新的无线,不引人注目的静音语音接口,使用柔软的磁性皮肤. 它准确地解码语音运动,为通信辅助和人机交互提供了强大的解决方案.
科学领域:
- 生物医学工程 生物医学工程
- 人与计算机的交互
- 可穿戴技术可穿戴技术
背景情况:
- 无声语音接口旨在恢复声音障碍患者的沟通,并在具有挑战性的声学环境中实现沟通.
- 现有的无声语音技术往往会受到体积庞大,侵入性,精度低,易受干扰的影响.
- 需要一些不引人注目的,准确和强大的无声语音识别系统.
研究的目的:
- 开发一个无线,不引人注目的,强大的无声语音接口.
- 追踪和解码时关节的与语音相关的运动,以实现无声语音识别.
- 展示开发的接口在辅助技术和人机交互方面的潜力.
主要方法:
- 一个单一的柔软磁性皮肤传感器放置在耳朵后面,用于数据采集.
- 基于机器学习的信号处理技术用于语音解码.
- 该系统被评估为语音识别准确性和对环境噪音和用户运动的稳定性.
主要成果:
- 开发的无声语音接口实现了高精度:93.2%的音符和87.3%的单词.
- 该系统证明了对环境噪音和日常用户运动的稳定性.
- 接口是无线的,不引人注目的,社会上是可以接受的,克服了现有的面部佩戴传感器的局限性.
结论:
- 拟议的软磁性基于皮肤的无声语音接口为恢复通信和增强人机交互提供了一个有前途的解决方案.
- 该系统的隐蔽性,准确性和稳定性使其适用于辅助技术应用.
- 未来的应用包括无声语音智能手机助手和无人机控制系统.
相关概念视频
01:31Hearing
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
01:15Auditory Pathway
Auditory pathways constitute the complex neural circuits responsible for transmitting and interpreting auditory information from the peripheral auditory system to the brain. Sound waves are initially captured by the outer ear, funneled through the ear canal, and reach the tympanic membrane (eardrum). These vibrations are transmitted via the middle ear's ossicles to the inner ear's cochlea.
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
When viewed cross-sectionally, the cochlea reveals the scala vestibuli and scala tympani flanking the...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...