Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Facial Feedback Hypothesis01:24

Facial Feedback Hypothesis

324
Charles Darwin proposed that facial expressions are an evolutionary adaptation for communication. He argued that these expressions are not influenced by culture but are universal across species. For example, a snarling expression with exposed teeth signals a threat in many animals, including humans. Darwin also suggested that displaying an emotion can intensify the feeling. Smiling, for example, could enhance one's sense of happiness. This idea laid the foundation for understanding the role...
324

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Measurement of Electrical Properties of Superconducting YBCO Thin Films in the VHF Range.

Materials (Basel, Switzerland)·2021
See all related articles

Related Experiment Video

Updated: Oct 22, 2025

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
07:18

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication

Published on: January 26, 2024

1.0K

Intuitive Cognition-Based Method for Generating Speech Using Hand Gestures.

Eldad Holdengreber1,2, Roi Yozevitch3, Vitali Khavkin1

  • 1Department of Mechanical Engineering and Mechatronics, Ariel University, Ariel 40700, Israel.

Sensors (Basel, Switzerland)
|August 28, 2021
PubMed
Summary
This summary is machine-generated.

This study introduces a novel speech technology that converts hand movements into vocal sounds, bypassing the need for sign language knowledge. This innovative approach offers a new communication pathway for individuals with speech disabilities.

Keywords:
Leap Motion Controllercognitive sensingdepth camerahand gestures recognitioninformation entropymutenessspeech disabilityspeech interface

More Related Videos

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
08:15

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Published on: March 28, 2025

857
Practical Methodology of Cognitive Tasks Within a Navigational Assessment
05:19

Practical Methodology of Cognitive Tasks Within a Navigational Assessment

Published on: June 1, 2015

13.8K

Related Experiment Videos

Last Updated: Oct 22, 2025

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication
07:18

Author Spotlight: Deciphering the Cognitive and Neural Mechanisms of Gesture in Communication

Published on: January 26, 2024

1.0K
Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
08:15

Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision

Published on: March 28, 2025

857
Practical Methodology of Cognitive Tasks Within a Navigational Assessment
05:19

Practical Methodology of Cognitive Tasks Within a Navigational Assessment

Published on: June 1, 2015

13.8K

Area of Science:

  • Biomedical Engineering
  • Human-Computer Interaction
  • Assistive Technology

Background:

  • Muteness presents a significant communication barrier, with existing technological solutions often requiring prior knowledge of sign language.
  • Current methods focus on translating mute languages into vocal acoustic sounds, limiting accessibility for some individuals.

Purpose of the Study:

  • To develop a novel speech generation technology that does not require prior sign language knowledge.
  • To create an intuitive speech interface based on basic phonetic principles and hand gesture recognition.

Main Methods:

  • Utilized a depth camera to sense hand movements, specifically analyzing three rotational components: yaw, pitch, and roll.
  • Developed a programming algorithm to convert detected hand rotations into phonetic elements (vowels and consonants).
  • Integrated the depth camera, speakers, and cognitive activity into a unique speech interface.

Main Results:

  • Demonstrated a functional prototype of the speech interface capable of generating speech from hand movements.
  • Showcased the potential for users to develop speech through an intuitive cognitive process linked to brain activity.
  • Substantiated the device's potential as a viable solution for individuals with speech impairments.

Conclusions:

  • The proposed technology offers a new paradigm for speech generation, independent of existing language structures.
  • The intuitive nature of the interface allows for natural speech development, mimicking natural vocal cord function.
  • The successful prototype performance indicates a promising future for this assistive technology in addressing speech disabilities.