Search research articles

ABOUT JoVE

Overview Leadership Blog JoVE Help Center

AUTHORS

Publishing Process Editorial Board Scope & Policies Peer Review FAQ Submit

LIBRARIANS

Testimonials Subscriptions Access Resources Library Advisory Board FAQ

RESEARCH

JoVE Journal Methods Collections JoVE Encyclopedia of Experiments Archive

EDUCATION

JoVE Core JoVE Business JoVE Science Education JoVE Lab Manual Faculty Resource Center Faculty Site

Terms & Conditions of Use

Related Concept Videos

Improving Translational Accuracy

Improving Translational Accuracy

Higher Mental Functions of the Brain: Language

Higher Mental Functions of the Brain: Language

Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by

Same author

COVID-19 CT-images diagnosis and severity assessment using machine learning algorithm.

Cluster computing·2023

Same author

A novel computational method for assigning weights of importance to symptoms of COVID-19 patients.

Artificial intelligence in medicine·2021

Same author

An IoT-based framework for early identification and monitoring of COVID-19 cases.

Biomedical signal processing and control·2020

Same author

A comprehensive study on feature types for osteoporosis classification in dental panoramic radiographs.

Computer methods and programs in biomedicine·2020

Same author

Novel navigation assistive device for deaf drivers.

Assistive technology : the official journal of RESNA·2020

Same author

Parallel scheme for real-time detection of photosensitive seizures.

Computers in biology and medicine·2016

Same journal

3D-printed foot orthoses with customized somatosensory stimulation knobs enhance balance and stability in older adults.

Assistive technology : the official journal of RESNA·2026

Same journal

Unlocking independence: A case series on the impact of mobile device instruction in acquired communication disorders.

Assistive technology : the official journal of RESNA·2026

Same journal

The role of assistive technology in supporting university students with visual impairments.

Assistive technology : the official journal of RESNA·2026

Same journal

The biomechanical effects of 3D-printed ankle-foot orthosis in individuals with unilateral foot drop.

Assistive technology : the official journal of RESNA·2026

Same journal

Accelerating responsibly: From novelty to necessity in visual assistive technology.

Assistive technology : the official journal of RESNA·2026

Same journal

Identifying key needs for educational puzzle toys for children with hearing impairments using a Kano-AHP approach.

Assistive technology : the official journal of RESNA·2026

See all related articles

Search research articles

Related Experiment Video

Updated: Mar 8, 2026

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

Ambient intelligence framework for real-time speech-to-sign translation.

Mwaffaq Otoom¹, Mohammad A Alzubaidi¹

¹a Computer Engineering Department , Yarmouk University , Irbid , Jordan.

Assistive Technology : the Official Journal of RESNA

|February 3, 2017

Summary

This summary is machine-generated.

This study introduces a real-time speech-to-sign translation device for deaf and hard-of-hearing individuals. Eye-tracking feedback significantly improved translation accuracy and reduced errors, enhancing accessibility for video content.

Keywords:

assistive devices deaf hard of hearing persons machine learning satisfaction sign language smartphones streaming videos

More Related Videos

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

Related Experiment Videos

Last Updated: Mar 8, 2026

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Virtual Agent for Real-Time Motivational Interviewing by Integrating Adaptive Nonverbal Behavior and Language Models

Published on: December 23, 2025

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Author Spotlight: Addressing Technical and Subjective Challenges in Measuring Classroom Attention

Published on: December 15, 2023

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Author Spotlight: Investigating the Impact of Emotional Prosodies on Voice Recognition and Perception

Published on: August 9, 2024

Area of Science:

Assistive Technology
Human-Computer Interaction
Sign Language Recognition

Background:

Sign language is crucial for communication among the deaf and hard-of-hearing (Deaf/HH) community.
Video streaming enables global communication but often lacks sign language support.
Existing solutions may not offer real-time translation for dynamic content.

Purpose of the Study:

To develop a prototype assistive device for real-time speech-to-sign translation.
To enable Deaf/HH individuals to access and understand mobile streaming video content.
To improve translation accuracy using eye-tracking based user-satisfaction detection and dynamic learning.

Main Methods:

Development of a prototype speech-to-sign translation system.
Implementation of pipelined and parallel processing for real-time translation.
Integration of eye-tracking for user-satisfaction detection to dynamically refine translations.
Conducting performance and usability evaluations with nine deaf participants.

Main Results:

Real-time translation with viewer's attention feedback reduced sign error rates (SER) by 16%.
Translation accuracy, measured by the Bilingual Evaluation Understudy (BLEU) metric, increased by 5.4% compared to a baseline system.
Usability studies confirmed the device is pleasant and satisfying for deaf users.

Conclusions:

The developed assistive device enhances real-time speech-to-sign translation accuracy and reduces errors.
Eye-tracking feedback integration proves effective in improving translation quality for video content.
The device shows potential for increasing engagement of deaf individuals in daily activities and digital content consumption.