Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sensory Modalities01:15

Sensory Modalities

1.1K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
1.1K
Tactile and Chemical Senses01:27

Tactile and Chemical Senses

273
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.
273
Learning Disabilities01:25

Learning Disabilities

81
Learning disabilities are cognitive disorders caused by neurological impairments that affect cognitive functions like language and reading, without indicating overall intellectual or developmental challenges. These disabilities differ from global intellectual or developmental disabilities as they are limited to distinct cognitive functions. Common learning disabilities include dysgraphia, dyslexia, and dyscalculia, each of which impacts unique aspects of learning.
Dyslexia
Dyslexia is a...
81
Design Example: Resistive Touchscreen01:14

Design Example: Resistive Touchscreen

271
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
271
Auditory Perception01:17

Auditory Perception

306
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
306
Perception of Sound Waves01:01

Perception of Sound Waves

4.4K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Cross-Modal Feature Adapter for Few-Shot Human Activity Recognition.

IEEE journal of biomedical and health informatics·2026
Same author

Motion prediction for leader manipulator of teleoperation system with large time delay based on inverse optimal control.

ISA transactions·2026
Same author

Dual-Modal Safety Framework for Robotic-Assisted Bronchoscopy via Endoscopic Vision and Haptic Feedback.

The international journal of medical robotics + computer assisted surgery : MRCAS·2026
Same author

Towards Interpretable Seizure Detection: An Excitation/Inhibition Dynamic Polynomial Network Framework for Electroencephalography.

Sensors (Basel, Switzerland)·2026
Same author

The signaling and regulatory functions of dying cells and cell corpses.

Communications biology·2026
Same author

Bioinspired Swallowing Soft Gripper with Toroidal Optical Waveguides for Multimodal Interactive Perception.

Soft robotics·2026

Related Experiment Video

Updated: May 24, 2025

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.3K

Visually Impaired People Learning Virtual Textures Through Multimodal Feedback Combining Vibrotactile and Voice.

Dapeng Chen, Yi Ding, Hao Wu

    IEEE Transactions on Neural Systems and Rehabilitation Engineering : a Publication of the IEEE Engineering in Medicine and Biology Society
    |March 3, 2025
    PubMed
    Summary

    This study introduces a multimodal feedback system for virtual texture learning, enabling blind and visually impaired individuals to perceive textures through vibration and audio cues. The system enhances object cognition by linking haptic sensations with texture attributes.

    More Related Videos

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
    05:43

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

    Published on: May 23, 2019

    5.4K
    Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
    05:12

    Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

    Published on: September 18, 2017

    545.8K

    Related Experiment Videos

    Last Updated: May 24, 2025

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
    09:01

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

    Published on: March 27, 2013

    14.3K
    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
    05:43

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

    Published on: May 23, 2019

    5.4K
    Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another
    05:12

    Using Virtual Reality to Transfer Motor Skill Knowledge from One Hand to Another

    Published on: September 18, 2017

    545.8K

    Area of Science:

    • Human-Computer Interaction
    • Haptics
    • Virtual Reality

    Background:

    • Existing haptic rendering methods for virtual textures are inaccessible to the blind and visually impaired (BVI).
    • Effective virtual texture perception is crucial for object cognition, especially for BVI individuals.
    • Multimodal feedback systems can bridge sensory gaps in virtual environments.

    Purpose of the Study:

    • To develop and evaluate a virtual texture learning system for BVI individuals.
    • To enhance object cognition in BVI users through interactive virtual texture experiences.
    • To create a system that translates visual texture information into perceivable haptic and auditory feedback.

    Main Methods:

    • Developed an Informer-based haptic rendering model to generate vibration acceleration (VA) signals from texture images and action data.
    • Implemented a texture classification method utilizing the generated VA signals.
    • Integrated audio feedback to broadcast classified texture attributes (type, material) to users.
    • Conducted user experiments to compare rendering models and evaluate texture matching accuracy in different learning modes.

    Main Results:

    • The proposed rendering model accurately and efficiently generates VA signals, providing realistic vibration feedback.
    • The system successfully enables BVI users to perceive virtual texture attributes through vibrotactile and auditory cues.
    • User experiments demonstrated the effectiveness of the system in enhancing texture perception and matching accuracy for BVI individuals.

    Conclusions:

    • The developed multimodal system significantly improves virtual texture learning for BVI individuals.
    • The Informer-based haptic rendering model offers a novel approach to generating effective haptic feedback.
    • This technology has the potential to enhance object recognition and cognitive abilities in BVI users through virtual experiences.