Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Perception of Sound Waves01:01

Perception of Sound Waves

The human ear is not equally sensitive to all frequencies in the audible range. It may perceive sound waves with the same pressure but different frequencies as having different loudness. Moreover, the perception of sound waves depends on the health of an individual's ears, which decays with age. The health of one's ears may also be affected by regular exposure to loud noises.
The pitch of a sound depends on the frequency and the pressure amplitude of the source. Two sounds of the same frequency...
Sound as Pressure Waves01:17

Sound as Pressure Waves

Sound waves, which are longitudinal waves, can be modeled as the displacement amplitude varying as a function of the spatial and temporal coordinates. As a column of the medium is displaced, its successive columns are also displaced. As the successive displacements differ relatively, a pressure difference with the surrounding pressure is created. The gauge pressure varies across the medium.
The pressure fluctuation depends on the difference in displacements between the successive points in the...
Relative Motion Analysis using Rotating Axes01:25

Relative Motion Analysis using Rotating Axes

Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame.
However, to express the relative position of point B relative to point A, an additional frame of reference, denoted as x'y', is necessary. This additional frame not only translates but also rotates relative to the fixed frame, making it instrumental in...
Relative Motion Analysis - Acceleration01:10

Relative Motion Analysis - Acceleration

A slider-crank mechanism converts rotational motion from the crank into linear motion of the slider or vice versa. This mechanism consists of three main parts: the crank, the connecting rod, and the slider. The movement of the slider-crank is an example of general plane motion as the fluctuating angle between the crank and the connecting rod. Consider a segment AB where point A is at the end of the slider and point B is on the diametrically opposite end to point A, on a crack. The variance in...
Relative Motion Analysis using Rotating Axes - Acceleration01:22

Relative Motion Analysis using Rotating Axes - Acceleration

Consider a component AB undergoing a linear motion. Along with a linear motion, point B also rotates around point A. To comprehend this complex movement, position vectors for both points A and B are established using a stationary reference frame. The absolute velocity of point B is determined by adding the absolute velocity of point A, the relative velocity of point B in the rotating frame, and the effects caused by the angular velocity within the rotating frame.
Time differentiation is...
Perceiving Loudness, Pitch, and Location01:21

Perceiving Loudness, Pitch, and Location

The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

ThermalTexture: Temperature-Integrated Surface Rendering Using Thermal Referral Induced by Texture Slip-Feedback.

IEEE transactions on haptics·2026
Same author

Targeting the NLRP3-NEK7 axis with rebamipide: Drug repurposing in Parkinson's disease.

Neural regeneration research·2025
Same author

Effectiveness of a Karaoke-Based Digital Therapeutic in Mild Cognitive Impairment: A Randomized, 12-Week Pilot Trial.

Psychiatry investigation·2025
Same author

Protective Effects of Standardized Peucedanum Japonicum Thunb. Extract Against UVB-Induced Corneal Epithelial Apoptosis via Mitochondrial Regulation.

Frontiers in bioscience (Landmark edition)·2025
Same author

SpinTexture: Exploring Scanning Realism From Concentric to Uni-Directional Slip Feedback Using a Spinning Textured Disk.

IEEE transactions on haptics·2025
Same author

Melatonin Ameliorates Desiccation Stress-Induced Ocular Inflammation in an In Vitro Model by Activating the Nrf2 Pathway.

Journal of cellular and molecular medicine·2025

Related Experiment Video

Updated: Jun 29, 2026

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.3K

Enhancing Video Experiences for DHH Individuals Through Sound-Inspired Motion Caption-Based Spatiotemporal Tacton.

Sooyeon Ahn, Gyungmin Jin, Gunhyuk Park

    IEEE Transactions on Haptics
    |April 1, 2025
    PubMed
    Summary

    This study introduces the Motion Caption Haptic System (MCHS) to enhance video accessibility for deaf and hard of hearing (DHH) individuals. MCHS uses animated captions and haptic feedback to convey non-verbal sounds, improving the viewing experience.

    More Related Videos

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
    05:43

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

    Published on: May 23, 2019

    5.4K
    Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
    11:39

    Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

    Published on: September 7, 2022

    1.8K

    Related Experiment Videos

    Last Updated: Jun 29, 2026

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
    09:01

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

    Published on: March 27, 2013

    14.3K
    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
    05:43

    Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback

    Published on: May 23, 2019

    5.4K
    Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
    11:39

    Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

    Published on: September 7, 2022

    1.8K

    Area of Science:

    • Human-Computer Interaction
    • Accessibility Technology
    • Multimedia Systems

    Background:

    • Current video captions primarily convey linguistic content, excluding non-verbal audio information crucial for understanding.
    • Deaf and hard of hearing (DHH) individuals face challenges in perceiving sound nuances like music, sound effects, and emotional tone in videos.
    • Existing accessibility solutions for DHH viewers often lack comprehensive methods for representing non-auditory information.

    Purpose of the Study:

    • To design and develop a multimodal system, the Motion Caption Haptic System (MCHS), to convey non-verbal sound information to DHH individuals.
    • To create animated captions and spatiotemporal haptic patterns that effectively represent various sound effects and spoken emotions.
    • To evaluate the effectiveness of MCHS in improving the video viewing experience for DHH users.

    Main Methods:

    • Designed a multimodal system (MCHS) integrating animated captions and spatiotemporal vibration patterns.
    • Developed specific motion captions and haptic patterns for representative sound effects and spoken emotions.
    • Conducted surveys with DHH and hearing participants to refine the design of motion captions and haptic patterns.
    • Evaluated the MCHS with 19 DHH individuals to assess its impact on video viewing experience.

    Main Results:

    • The MCHS effectively conveys non-verbal sound information through integrated animated captions and haptic feedback.
    • Participant evaluations indicated that MCHS has the potential to significantly improve the video viewing experience for DHH individuals.
    • The study identified key design considerations for multimodal captioning systems tailored for DHH viewers.

    Conclusions:

    • The Motion Caption Haptic System (MCHS) offers a promising approach to enhance video accessibility for DHH individuals by incorporating non-verbal sound cues.
    • Multimodal systems combining visual (animated captions) and tactile (haptic feedback) elements can provide a more immersive and comprehensive video experience.
    • Further research is needed to address design challenges and optimize multimodal captioning for diverse DHH user needs.