Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Synesthesia01:27

Synesthesia

252
Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
252
Sensory Modalities01:15

Sensory Modalities

2.6K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
2.6K
Introduction to Special Senses01:26

Introduction to Special Senses

6.4K
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive...
6.4K
Sensory Perception: Organization of the Somatosensory System01:11

Sensory Perception: Organization of the Somatosensory System

9.1K
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the...
9.1K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

A History of Suicide Attempt Is Associated with Increased Sympathetic Activation in Bipolar Disorder.

Canadian journal of psychiatry. Revue canadienne de psychiatrie·2023
Same author

Online Continual Learning in Acoustic Scene Classification: An Empirical Study.

Sensors (Basel, Switzerland)·2023
Same author

Predictors of adherence to electronic self-monitoring in patients with bipolar disorder: a contactless study using Growth Mixture Models.

International journal of bipolar disorders·2023
Same author

Possibility of Benzene Exposure in Workers of a Semiconductor Industry Based on the Patent Resources, 1990-2010.

Safety and health at work·2021
Same author

Accelerating On-Device Learning with Layer-Wise Processor Selection Method on Unified Memory.

Sensors (Basel, Switzerland)·2021
Same author

Multi-Path and Group-Loss-Based Network for Speech Emotion Recognition in Multi-Domain Datasets.

Sensors (Basel, Switzerland)·2021

Related Experiment Video

Updated: Oct 30, 2025

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.2K

Analysis and Validation of Cross-Modal Generative Adversarial Network for Sensory Substitution.

Mooseop Kim1, YunKyung Park1, KyeongDeok Moon1

  • 1Human Enhancement & Assistive Technology Research Section, Artificial Intelligence Research Lab., Electronics Telecommunications Research Institute (ETRI), Daejeon 34129, Korea.

International Journal of Environmental Research and Public Health
|July 2, 2021
PubMed
Summary

This study introduces a deep learning method to optimize auditory sensitivity for visual-auditory sensory substitution, reducing latency and improving performance for visually impaired individuals.

Keywords:
auditory sensitivitycross-modal perceptiongenerative adversarial networksensory substitutionvisual perception

More Related Videos

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.3K
A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.7K

Related Experiment Videos

Last Updated: Oct 30, 2025

Cross-Modal Multivariate Pattern Analysis
13:51

Cross-Modal Multivariate Pattern Analysis

Published on: November 9, 2011

20.2K
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.3K
A Method to Study Adaptation to Left-Right Reversed Audition
07:14

A Method to Study Adaptation to Left-Right Reversed Audition

Published on: October 29, 2018

6.7K

Area of Science:

  • Neuroscience
  • Computer Science
  • Assistive Technology

Background:

  • Visual-auditory sensory substitution aids visually impaired individuals but suffers from high latency.
  • Existing methods for analyzing auditory sensitivity are subjective and rely on human behavior.

Purpose of the Study:

  • To propose a novel cross-modal generative adversarial network (GAN)-based evaluation method to determine optimal auditory sensitivity.
  • To reduce transmission latency in visual-auditory sensory substitution systems.
  • To enhance the perception of visual information for the visually impaired.

Main Methods:

  • Developed a cross-modal GAN to analyze auditory sensitivity.
  • Conducted human-based assessments with sighted users, congenitally blind, and late-blind individuals.
  • Evaluated the model's effectiveness through behavioral experiments.

Main Results:

  • The proposed GAN model successfully reduced the temporal length of auditory signals by 50%.
  • This reduction indicates a potential twofold improvement in the performance of existing methods like vOICe.
  • Experimental results aligned with human assessments, validating the model's effectiveness.

Conclusions:

  • Deep learning analysis of auditory sensitivity can significantly improve sensory substitution efficiency.
  • The proposed method offers a more objective and efficient approach to optimizing assistive technologies for the blind.
  • This research paves the way for more responsive and effective visual-auditory sensory substitution systems.