Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Design Example01:23

Design Example

398
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
398
Perception of Sound Waves01:01

Perception of Sound Waves

4.8K
The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same...
4.8K
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

518
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by...
518
Design Example: Vintage Mixing Console01:17

Design Example: Vintage Mixing Console

323
A sound engineer at a music company recently encountered a problem. The output from their newly acquired studio's vintage mixing console was too low for the requirements of modern recording equipment. To rectify this situation, the engineer decided to design an audio pre-amplifier using an operational amplifier (op-amp) to boost the signal level.
The specifications for the pre-amplifier were clear. It needed to amplify the audio signal by a factor of 10, have an input impedance above 10...
323
Auditory Perception01:17

Auditory Perception

656
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
656
Sound as Pressure Waves01:17

Sound as Pressure Waves

2.7K
Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
2.7K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Visual field inhomogeneities and the architectonics of early visual cortex shape visual working memory.

Cerebral cortex (New York, N.Y. : 1991)·2026
Same author

Validation of the weight self-stigma questionnaire in a polish sample: Factor structure and measurement invariance by gender.

Journal of psychosomatic research·2025
Same author

Co-occurrence of posttraumatic stress disorder symptoms and food addiction in a large Polish sample: latent profile analysis.

European journal of psychotraumatology·2025
Same author

Systemic inflammation and metabolic syndrome components in threshold/subthreshold posttraumatic stress disorder and food addiction in a Polish community sample.

European journal of psychotraumatology·2025
Same author

Psychological differences in food addiction and binge eating in a general Polish population.

Scientific reports·2025
Same author

Exploration of the Conditions for Occurrence of Photoplethysmographic Signal Inversion above the Dorsalis Pedis Artery.

Sensors (Basel, Switzerland)·2024

Related Experiment Video

Updated: Oct 13, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.7K

Colorophone 2.0: A Wearable Color Sonification Device Generating Live Stereo-Soundscapes-Design, Implementation, and

Dominik Osiński1, Marta Łukowska2, Dag Roar Hjelme1

  • 1Department of Electronic Systems, Norwegian University of Science and Technology, NO-7491 Trondheim, Norway.

Sensors (Basel, Switzerland)
|November 13, 2021
PubMed
Summary

This study developed a wearable sensory substitution device for the visually impaired, converting visual color information into spatialized soundscapes. Usability tests evaluated prototypes for intuitive auditory representation of the visual environment.

Keywords:
Colorophoneassistive devicecolor sonificationhuman–computer interactionmultimodal perceptionsensory substitutionwearable device

More Related Videos

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.3K
Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
06:04

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages

Published on: March 24, 2023

511

Related Experiment Videos

Last Updated: Oct 13, 2025

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

4.7K
Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
11:39

Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

Published on: September 7, 2022

2.3K
Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages
06:04

Systematic Hearing Performance Evaluation Process for Adolescents with Cochlear Implantation at Early Ages

Published on: March 24, 2023

511

Area of Science:

  • Human-Computer Interaction
  • Sensory Substitution
  • Assistive Technology

Background:

  • Developing intuitive sensory substitution devices for the visually impaired remains a significant challenge.
  • Existing devices often lack naturalistic auditory representations of the visual environment.
  • Color sonification offers a potential pathway for auditory perception of visual information.

Purpose of the Study:

  • To present the design, development, and usability audit of a novel wearable system for spatial color sonification.
  • To create an auditory representation of the visual environment for visually impaired individuals.
  • To evaluate the effectiveness and user-friendliness of two prototype devices and their associated graphical user interfaces (GUIs).

Main Methods:

  • Development of a wearable system using a dedicated color space to convert spatial color information into soundscapes.
  • Implementation of a camera-based system generating natural, spatialized sounds.
  • Creation of two head-mounted prototype devices and two GUI versions (one for researchers, one for visually impaired users).
  • Conducting fundamental usability tests to evaluate the color sonification algorithm and compare prototypes.

Main Results:

  • Successful development of a wearable color sonification system capable of generating spatialized soundscapes from visual input.
  • Two distinct GUI versions were created, tailored for researchers and visually impaired users respectively.
  • Usability tests provided data for evaluating the novel spatial color sonification algorithm and comparing prototype effectiveness.

Conclusions:

  • The developed system offers a promising approach to auditory representation of the visual environment for the visually impaired community.
  • Usability testing highlighted areas for improvement and provided recommendations for future iterations.
  • Further development of intuitive sensory substitution devices is crucial for enhancing accessibility for visually impaired individuals.