Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Experiment Videos

Development of speechreading supplements based on automatic speech recognition.

P Duchnowski1, D S Lum, J C Krause

  • 1Research Laboratory of Electronics, Massachusetts Institute of Technology, Cambridge 02139, USA.

IEEE Transactions on Bio-Medical Engineering
|April 14, 2000
PubMed
Summary
This summary is machine-generated.

Related Concept Videos

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

What Do We Know So Far About Ventricular Arrhythmias and Sudden Cardiac Death Prediction in the Mitral Valve Prolapse Population? Could Biomarkers Help Us Predict Their Occurrence?

Current cardiology reports·2024
Same author

Force distribution in a scalar model for noncohesive granular material.

Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics·2002
Same author

Neurobiological foundations for the theory of harmony in western tonal music.

Annals of the New York Academy of Sciences·2001
Same author

A single-band envelope cue as a supplement to speechreading of segmentals: a comparison of auditory versus tactual presentation.

Ear and hearing·2001
Same author

A method to determine the speech transmission index from speech waveforms.

The Journal of the Acoustical Society of America·2000
Same author

Effects of token variability on our ability to distinguish between vowels.

Perception & psychophysics·1998
Same journal

SleepConFormer: A Single-Channel EEG Framework for Sleep Staging and Consciousness Assessment in Patients with Disorders of Consciousness.

IEEE transactions on bio-medical engineering·2026
Same journal

Modeling Partial and Total Support of Left Ventricular Assist Device for Discrete Hemodynamic Control Framework.

IEEE transactions on bio-medical engineering·2026
Same journal

A Low-Cost Wearable TI-TACS Stimulator With Bipolar Quadratic-Boost Converter for Current Stimulation Validation in the Rat Brain.

IEEE transactions on bio-medical engineering·2026
Same journal

EMG-Based Gait Estimation Using Koopman-Inspired Method.

IEEE transactions on bio-medical engineering·2026
Same journal

Soft Everting Robots for Medical Applications: A Review.

IEEE transactions on bio-medical engineering·2026
Same journal

Arterial spin labeling cerebral blood flow quantification from quantitative transport mapping based on multiscale fluid mechanics simulation and deep learning.

IEEE transactions on bio-medical engineering·2026
See all related articles

Manual-cued speech (MCS) uses hand gestures to improve speech clarity for deaf individuals. An automated system enhances keyword recognition by two-thirds compared to speechreading alone.

Area of Science:

  • Augmentative and Alternative Communication (AAC)
  • Speech Processing
  • Human-Computer Interaction

Background:

  • Manual-cued speech (MCS) aids speechreaders by using handshapes for consonants and hand positions for vowels.
  • MCS significantly facilitates language acquisition and communication for deaf children.
  • Existing MCS requires manual production, limiting real-time application.

Purpose of the Study:

  • To describe an automated system for real-time generation of cued speech.
  • To evaluate the effectiveness of this automated cued speech system.

Main Methods:

  • A hidden Markov model (HMM)-based phonetic speech recognizer generated cues.
  • Context-dependent phone models were utilized for cue derivation.
  • Animated handshapes were superimposed on the speaker's face in real-time.

Related Experiment Videos

  • Trained MCS receivers evaluated the system's performance.

    • Main Results:

    • Automated cued speech improved keyword recognition to approximately two-thirds in low-context sentences.
    • Speechreading alone (SA) achieved roughly one-third keyword recognition.
    • System effectiveness depended on hand articulation and synchronization with facial cues.

    Conclusions:

    • Automated cued speech shows significant potential for improving conversational speech reception.
    • This technology can support more natural communication rates for individuals with hearing impairments.
    • Further refinement in articulation and synchronization is crucial for optimal performance.