Related Experiment Video
Updated: Jul 6, 2026
05:43
Applying Incongruent Visual-Tactile Stimuli during Object Transfer with Vibro-Tactile Feedback
Published on: May 23, 2019
Cross-modal links among vision, audition, and touch in complex environments
Thomas K Ferris1, Nadine B Sarter
1Department of Industrial and Operations Engineering, Center for Ergonomics, University of Michigan, 1205 Beal Ave., Ann Arbor, MI 48109, USA.
Human Factors
|March 22, 2008
Summary
Spatial links between visual, auditory, and tactile cues significantly impact performance in complex environments. These cross-modal effects and asymmetries are crucial for designing effective multimodal interfaces.
Area of Science:
- Human-computer interaction
- Cognitive psychology
- Multimodal interface design
Background:
- Previous research demonstrated cross-modal effects on stimulus processing using simple cues.
- Few studies explored these effects in complex environments to assess scalability and asymmetry.
- Understanding cross-modal constraints is vital for optimizing user performance.
Purpose of the Study:
- To determine if cross-modal spatial link performance effects scale to complex environments.
- To investigate the role of these effects in multimodal interface design.
- To re-examine cross-modal cuing asymmetries.
Main Methods:
- Utilized a microworld simulation of battlefield operations.
- Employed a complex task set with integrated visual, auditory, and tactile stimuli.
- Investigated cuing effects across all cross-modal pairings.
Main Results:
- Observed significant asymmetric performance effects of cross-modal spatial links.
- Auditory cues reduced response times for visual targets, but not vice versa.
- Faster responses to contralateral targets were noted for tactually cued auditory and visual-tactile targets.
Conclusions:
- Spatial relationships between multimodal cues and targets critically influence response times in complex settings.
- Cross-modal link performance effects and asymmetries require further investigation for interface design.
- Findings inform the design of adaptive interfaces and attention management in data-rich domains.
More Related Videos
Related Concept Videos
01:15Sensory Modalities
Sensation typically is the process by which the sensory receptors and sense organs detect stimuli from the internal and external environment and transmit this information to the central nervous system for processing.
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
General senses refer to the broad category of sensory information detected by receptors in the body and can be further grouped into somatic and visceral senses. Somatic sensations include touch, pressure, temperature, and pain and are essential for navigating our environment and...
01:27Tactile and Chemical Senses
Tactile senses encompass touch, temperature, and pain, each mediated by specific receptors. Touch receptors detect mechanical energy or pressure against the skin. Sensory fibers from these receptors enter the spinal cord and relay information to the brain stem. Here, most fibers cross over to the opposite side of the brain. The touch information then moves to the thalamus, which projects a map of the body's surface onto the somatosensory areas of the parietal lobes in the cerebral cortex. This...
01:26Introduction to Special Senses
Sensory receptors play an integral part in comprehending our external and internal environments. They receive diverse stimuli, converting them into the nervous system's electrochemical signals. This conversion occurs as the stimulus alters the sensory neuron's cell membrane potential, instigating the generation of an action potential. This action potential is subsequently transmitted to the central nervous system (CNS), which integrates with other sensory data or higher cognitive functions.
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:11Sensory Perception: Organization of the Somatosensory System
The somatosensory system is the central and peripheral nervous system component that senses and processes touch, pressure, pain, temperature, and body position or proprioception. The process of sensation takes place at three levels:
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
The receptor level:
The receptor level is the first stage of sensation. It involves the detection of a stimulus by specialized sensory receptors. The stimulus must arrive within the receptor's receptive field. Next, the receptor converts the energy of the stimulus...
01:12Visual Agnosia
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round end"...