Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Sensory Modalities01:15

Sensory Modalities

3.7K
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
3.7K
Tactile and Chemical Senses01:27

Tactile and Chemical Senses

690
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex.
690

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Accelerating responsibly: From novelty to necessity in visual assistive technology.

Assistive technology : the official journal of RESNA·2026
Same author

A model-based approach to study ant energetics from trajectory data.

PNAS nexus·2026
Same author

Markerless 3D hand tracking for analysis of pediatric eye-hand coordination.

MethodsX·2026
Same author

Hydrodynamic entanglement in the abyss: Morphological adaptations of groups of <i>Euplectella aspergillum</i>.

PNAS nexus·2026
Same author

Evaluating OCR performance for assistive technology: effects of walking speed, camera placement, and camera type.

Disability and rehabilitation. Assistive technology·2026
Same author

Dynamic stabilization of a mechanical oscillator in the absence of any stable feature.

Nature communications·2026

Related Experiment Video

Updated: Jan 10, 2026

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

5.0K

Re-imagining sensory substitution through gestural control: Point-To-Tell 2.

Ligao Ruan1, Giles Hamilton-Fletcher2,3, Mahya Beheshti1,2

  • 1Department of Mechanical and Aerospace Engineering, NYU Tandon School of Engineering, Brooklyn, NY, USA.

Disability and Rehabilitation. Assistive Technology
|November 20, 2025
PubMed
Summary
This summary is machine-generated.

This new gesture-controlled sensory substitution device (SSD) helps people who are blind or have low vision (pBLV) select and understand environmental information, reducing cognitive overload.

Keywords:
Assistive technologyhuman–computer interactionobject detectionsensory substitutionvisual impairment

More Related Videos

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

14.5K
Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses
05:21

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses

Published on: January 7, 2019

8.3K

Related Experiment Videos

Last Updated: Jan 10, 2026

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface
11:54

Real-Time Proxy-Control of Re-Parameterized Peripheral Signals using a Close-Loop Interface

Published on: May 8, 2021

5.0K
Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
13:44

Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy

Published on: August 8, 2011

14.5K
Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses
05:21

Characterization of the Sense of Agency over the Actions of Neural-machine Interface-operated Prostheses

Published on: January 7, 2019

8.3K

Area of Science:

  • Human-Computer Interaction
  • Assistive Technology
  • Computer Vision

Background:

  • Sensory substitution devices (SSDs) convert environmental data for individuals who are blind or have low vision (pBLV).
  • Existing SSDs often provide undifferentiated information, potentially causing cognitive overload and limiting user control.
  • There is a need for more intuitive and selective assistive technologies for pBLV.

Purpose of the Study:

  • To introduce and technically validate Point-To-Tell 2, a selective, gesture-controlled system for pBLV.
  • To enhance information relevance and reduce cognitive overload in assistive devices.
  • To connect spatial position and identity of objects through gestural control and proprioception.

Main Methods:

  • Integration of a monocular camera with AI pipelines for depth estimation, hand pose tracking, and object detection/segmentation.
  • Development of a system that identifies 3D pointing direction and announces object names and distances.
  • Utilizing pointing-based gestural control for private and efficient information selection.

Main Results:

  • High hand pose tracking accuracy demonstrated in controlled indoor environments.
  • Reliable ray-casting and object selection achieved, even with challenges in object recognition at distance.
  • Stable distance estimates at close range, with a noted systematic bias.

Conclusions:

  • The Point-To-Tell 2 system technically validates an improved assistive technology approach.
  • Focusing system feedback and leveraging concurrent hand proprioception can reduce cognitive load and enhance spatial comprehension.
  • Future work includes user testing and feature expansion for diverse scenarios.