Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Somatosensation01:33

Somatosensation

36.7K
The somatosensory system relays sensory information from the skin, mucous membranes, limbs, and joints. Somatosensation is more familiarly known as the sense of touch. A typical somatosensory pathway includes three types of long neurons: primary, secondary, and tertiary. Primary neurons have cell bodies located near the spinal cord in groups of neurons called dorsal root ganglia. The sensory neurons of ganglia innervate designated areas of skin called dermatomes.
36.7K
Hearing01:31

Hearing

52.4K
When we hear a sound, our nervous system is detecting sound waves—pressure waves of mechanical energy traveling through a medium. The frequency of the wave is perceived as pitch, while the amplitude is perceived as loudness.
52.4K
Design Example01:23

Design Example

332
The innovation of touch-tone telephony revolutionized the telecommunications industry by replacing the traditional rotary dial with a dual-tone multi-frequency (DTMF) signaling system. This system uses a matrix-style keypad with buttons arranged in four rows and three columns, creating 12 distinct signals each assigned to a pair of frequencies. Each button press results in a simultaneous generation of two sinusoidal tones – one from a low-frequency group (697 to 941 Hz) and one from a...
332
Synesthesia01:27

Synesthesia

136
Synesthesia is a remarkable condition where stimulation of one sensory or cognitive pathway leads to automatic, involuntary experiences in a second sensory or cognitive pathway. People with synesthesia experience a blending or crossing of their senses, such as sight and sound, leading to cross-modal sensations. In this condition, the stimulation of one sense, such as hearing a number or musical note, triggers an experience of another sense, like sensing a specific color, taste, or smell. People...
136
Auditory Perception01:17

Auditory Perception

343
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the...
343
Design Example: Resistive Touchscreen01:14

Design Example: Resistive Touchscreen

323
A device engineer plays a crucial role in designing user interfaces for mobile devices. One such interface is the resistive touchscreen, which fundamentally consists of two metallic layers: a flexible upper layer and a rigid lower layer, separated by a narrow gap. The high resistance between these two layers is a key characteristic of this design.
When a user touches the screen, the two layers make contact at a specific point known as the touchpoint. This contact reduces the resistance between...
323

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Sound, Touch, or the Full Monty? A Comparative Study of Accessible Data Exploration Systems for Blind Users.

ACM transactions on accessible computing·2026
Same author

Ambient Analytics: Calm Technology for Immersive Visualization and Sensemaking.

IEEE computer graphics and applications·2026
Same author

Hybrid User Interfaces: Past, Present, and Future of Complementary Cross-Device Interaction in Mixed Reality.

IEEE transactions on visualization and computer graphics·2026
Same author

"I Feel Like Iron Man": Authoring, Exploring, and Presenting Data Visualizations in Immersive AR.

IEEE transactions on visualization and computer graphics·2026
Same author

Eye of the Beholder: Towards Measuring Visualization Complexity.

IEEE transactions on visualization and computer graphics·2025
Same author

FormA11y - A tool for remediating PDF forms for accessibility: Designing a PDF Form Remediation Tool.

ACM transactions on computer-human interaction : a publication of the Association for Computing Machinery·2025
Same journal

MesoSplats: Texture Synthesis with Gaussian Splatting.

IEEE transactions on visualization and computer graphics·2026
Same journal

GLLA: A Unified Force-Directed Graph Layout Framework Supporting Local Adjustments.

IEEE transactions on visualization and computer graphics·2026
Same journal

Multi-Perception Crowd: Learning to combine entity and implicit perception for diverse crowd simulation.

IEEE transactions on visualization and computer graphics·2026
Same journal

Hiding in Plain Sight: Camouflaging Real-world Objects.

IEEE transactions on visualization and computer graphics·2026
Same journal

RTF2Mesh: Restricted Tangent Face Based Mesh Compression With Neural Displacement Fields.

IEEE transactions on visualization and computer graphics·2026
Same journal

Practical Occluder Generation for Mobile Games.

IEEE transactions on visualization and computer graphics·2026
See all related articles

Related Experiment Video

Updated: Jul 11, 2025

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
09:01

Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

Published on: March 27, 2013

14.4K

TactualPlot: Spatializing Data as Sound using Sensory Substitution for Touchscreen Accessibility.

Pramod Chundury, Yasmin Reyazuddin, J Bern Jordan

    IEEE Transactions on Visualization and Computer Graphics
    |November 3, 2023
    PubMed
    Summary
    This summary is machine-generated.

    TACTUALPLOT uses sound to help blind individuals explore data on touchscreens, offering a dynamic and accessible alternative to costly tactile graphics. This sensory substitution approach enhances spatial awareness through embodied cognition.

    More Related Videos

    Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
    11:39

    Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

    Published on: September 7, 2022

    2.2K
    A Method to Study Adaptation to Left-Right Reversed Audition
    07:14

    A Method to Study Adaptation to Left-Right Reversed Audition

    Published on: October 29, 2018

    6.6K

    Related Experiment Videos

    Last Updated: Jul 11, 2025

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
    09:01

    Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind

    Published on: March 27, 2013

    14.4K
    Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique
    11:39

    Assessment of Audio-Tactile Sensory Substitution Training in Participants with Profound Deafness Using the Event-Related Potential Technique

    Published on: September 7, 2022

    2.2K
    A Method to Study Adaptation to Left-Right Reversed Audition
    07:14

    A Method to Study Adaptation to Left-Right Reversed Audition

    Published on: October 29, 2018

    6.6K

    Area of Science:

    • Human-Computer Interaction
    • Accessibility Technology
    • Data Visualization for Visually Impaired

    Background:

    • Traditional tactile graphics for data visualization are costly and lack dynamic exploration capabilities.
    • Refreshable haptic displays are expensive and inaccessible to most blind individuals.
    • Existing methods limit interactive data exploration for blind users.

    Purpose of the Study:

    • To introduce TACTUALPLOT, a novel sensory substitution technique for exploring scatterplots using auditory feedback.
    • To leverage embodied cognition for spatial awareness in touch-based data interaction.
    • To develop a scalable and accessible data exploration method for blind individuals.

    Main Methods:

    • Developed TACTUALPLOT, combining touch interaction with sonified feedback on touchscreens.
    • Utilized embodied cognition principles for users to perceive 2D touch locations and spatial relationships.
    • Incorporated multi-finger interaction and adaptive sampling regions based on hand movement speed.
    • Informed by formative design sessions with a blind collaborator.

    Main Results:

    • TACTUALPLOT provides auditory feedback for touch interaction on scatterplots.
    • The technique enables perception of relative finger positions and chart characteristics.
    • Evaluated TACTUALPLOT against traditional tactile graphics on swell touch paper.
    • Demonstrated a scalable approach to data exploration through touch and sound.

    Conclusions:

    • TACTUALPLOT offers a viable, dynamic, and accessible alternative to static tactile graphics.
    • Sensory substitution through combined touch and sound enhances data exploration for the visually impaired.
    • The approach supports spatial awareness and scalable data sampling for improved accessibility.