Related Experiment Video
Updated: Jun 20, 2026
05:43
Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
Published on: May 23, 2019
Integration of vision and haptics during tool use
Chie Takahashi1, Jörn Diedrichsen, Simon J Watt
1Wolfson Centre for Cognitive Neuroscience, School of Psychology, Bangor University, Wales, UK. c.takahashi@bangor.ac.uk
Journal of Vision
|September 19, 2009
Summary
The brain integrates visual and haptic information using tools by focusing on the tool-tip, not the hand. This cross-modal integration is near-optimal, even with spatial offsets, demonstrating a sophisticated sensory processing strategy.
Area of Science:
- Neuroscience
- Sensory Integration
- Human-Computer Interaction
Background:
- The brain faces a correspondence problem when integrating visual and haptic signals, ensuring information pertains to the same object.
- Grasping typically relies on coinciding hand and object positions for signal integration.
- Tool use introduces spatial separation between visual object information and hand location, complicating sensory integration.
Purpose of the Study:
- To investigate how the brain integrates visual and haptic information during tool-assisted size estimation.
- To determine if spatial offsets between visual and haptic signals affect cross-modal integration during tool use.
- To understand the neural basis of sensory integration when using tools.
Main Methods:
- Participants estimated object size using a simple tool, with controlled spatial offsets between visual and haptic signals.
- Behavioral data on size estimation accuracy and integration were analyzed.
- Comparisons were made between tool use conditions and normal grasping without tools.
Main Results:
- The brain integrates visual and haptic information in a near-optimal manner during tool-assisted size estimation, despite significant spatial offsets.
- Spatial offsets between the tool-tip and the object reduced cross-modal integration similarly to offsets between the hand and object in normal grasping.
- Haptic signals during tool use are treated as originating from the tool-tip, not the hand.
Conclusions:
- During tool use, the brain integrates visual and haptic information based on the perceived location of the tool-tip, not the hand.
- Sensory integration during tool use considers the distal cause of stimuli and the tool's properties (dynamics, geometry).
- This suggests a sophisticated multisensory processing strategy that adapts to the presence and characteristics of tools.
Related Concept Videos
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:27Tactile and Chemical Senses
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex. This...