JawLink:用于监控面部或脸部运动和检测语音的耳内光学接口
概括
这项研究引入了一种新的耳内传感系统,用于无手语音检测. 该技术通过分析耳道组织变形来准确识别语音意图,为先进的语音假肢铺平了道路.
科学领域:
- 生物医学工程 生物医学工程
- 辅助技术 辅助技术 辅助技术
- 信号处理 信号处理
背景情况:
- 目前的语音假体 (气管食管假体,电喉) 需要手动激活,限制了用户的自主权.
- 在全喉切除术后恢复自然的,手自由的言语控制是一个重大挑战.
研究的目的:
- 为了研究一种耳内近距离感应方法,用于无手检测语音意图.
- 在下运动期间利用耳道的软组织变形来进行言语检测.
- 开发一个实时的系统,无手控制语音假肢.
主要方法:
- 十名健康的参与者配备了包含红外传感器的定制耳朵设备.
- 红外信号记录了语音和非语音任务期间的耳道变形.
- 信号预处理包括过和波形变换,然后是特征提取和机器学习分类 (增强树,神经网络).
主要成果:
- 该系统检测到一致的声声前和声声后激活阶段,表明了发音的意图.
- 使用交叉验证,语音检测实现了平均F1分数为84.04%±4.48%.
- 区分语音和非语音活动 (,打哈欠) 产生了高F1得分94.49% ± 2.49%.
结论:
- 耳内变形信号可以在健康个体中强有力的检测话语意图.
- 这项技术使得语音假肢可以在自由使用手中进行控制,从而提高了可用性.
- 这种谨慎的可穿戴系统为声音障碍患者提供了一个有前途的辅助通信解决方案.
相关概念视频
The Auditory Ossicles
2.9K
The auditory ossicles of the middle ear transmit sounds from the air as vibrations to the fluid-filled cochlea. The auditory ossicles consist of two malleus (hammer) bones, two incus (anvil) bones, and two stapes (stirrups), one on each side. These bones develop during the fetal stage and are the ones to ossify first. They are fully mature at birth and do not grow afterward.
The aptly named stapes look very much like a stirrup. The three ossicles are unique to mammals, and each plays a role in...
The aptly named stapes look very much like a stirrup. The three ossicles are unique to mammals, and each plays a role in...
2.9K
Hearing
56.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
56.4K
Anatomy of the Ear
11.1K
Auditory sensation, commonly called hearing, involves the transformation of sonic waves into neural impulses facilitated by the structures of the auditory organ. The prominent, flesh-like structure on the side of the head, called the auricle, directs sound waves towards the auditory canal. The auricle is often mislabeled as the pinna, a term more aligned with mobile structures like a feline's external ear. The auditory canal penetrates the cranium via the external auditory meatus of the...
11.1K
Perceiving Loudness, Pitch, and Location
921
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
921
Facial Feedback Hypothesis
560
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
560
Pulse Oximetry
1.2K
Pulse oximetry, or SpO2, is a non-invasive method for continuously monitoring arterial oxygen saturation (SaO2). This procedure involves attaching a probe or sensor to the patient's fingertip, forehead, earlobe, or nose bridge. The sensor works by detecting changes in oxygen saturation levels through light signals generated by the oximeter and reflected by the pulsing blood under the probe.
Purpose
Average SpO2 values are greater than 95%. If the readings fall below 90%, it indicates that...
Purpose
Average SpO2 values are greater than 95%. If the readings fall below 90%, it indicates that...
1.2K


