Related Experiment Video
Updated: Feb 9, 2026
Ultrasound Images of the Tongue: A Tutorial for Assessment and Remediation of Speech Sound Errors
Published on: January 3, 2017
Development of sEMG sensors and algorithms for silent speech recognition
Geoffrey S Meltzner1, James T Heaton2, Yunbin Deng3
1VocaliD, Inc. 50 Leonard St, Belmont, MA 02478, United States of America.
Objective:
Speech is among the most natural forms of human communication, thereby offering an attractive modality for human-machine interaction through automatic speech recognition (ASR). However, the limitations of ASR-including degradation in the presence of ambient noise, limited privacy and poor accessibility for those with significant speech disorders-have motivated the need for alternative non-acoustic modalities of subvocal or silent speech recognition (SSR).
Approach:
We have developed a new system of face- and neck-worn sensors and signal processing algorithms that are capable of recognizing silently mouthed words and phrases entirely from the surface electromyographic (sEMG) signals recorded from muscles of the face and neck that are involved in the production of speech. The algorithms were strategically developed by evolving speech recognition models: first for recognizing isolated words by extracting speech-related features from sEMG signals, then for recognizing sequences of words from patterns of sEMG signals using grammar models, and finally for recognizing a vocabulary of previously untrained words using phoneme-based models. The final recognition algorithms were integrated with specially designed multi-point, miniaturized sensors that can be arranged in flexible geometries to record high-fidelity sEMG signal measurements from small articulator muscles of the face and neck.
Main Results:
We tested the system of sensors and algorithms during a series of subvocal speech experiments involving more than 1200 phrases generated from a 2200-word vocabulary and achieved an 8.9%-word error rate (91.1% recognition rate), far surpassing previous attempts in the field.
Significance:
These results demonstrate the viability of our system as an alternative modality of communication for a multitude of applications including: persons with speech impairments following a laryngectomy; military personnel requiring hands-free covert communication; or the consumer in need of privacy while speaking on a mobile phone in public.
Related Concept Videos
01:12Trial and Error and Algorithm
01:29Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
01:43Sustainable Development
01:22Language Development
The critical period for language acquisition suggests that the ability to acquire language is at its peak early in life. As people age, this proficiency decreases. Language development begins very...
01:15Development of the Lymphatic System
The first lymph sacs to form are the paired jugular lymph sacs located at the junction of the internal jugular and subclavian veins. From these sacs, lymphatic capillary plexuses extend to the thorax, upper limbs, neck, and head, eventually forming lymphatic vessels. Each jugular lymph sac maintains a...
01:22Development of Immunocompetence
The initial cells that migrate from the fetal thymus settle within the skin and epithelial tissues lining the mouth, digestive tract, and in females, the uterus and vagina. These cells, including skin-based dendritic cells, serve as antigen-presenting cells, playing a key role in T cell activation.
Subsequent T...