Related Experiment Video
Updated: Jul 18, 2026
09:01
Development of an Audio-based Virtual Gaming Environment to Assist with Navigation Skills in the Blind
Published on: March 27, 2013
Cognitive load of navigating without vision when guided by virtual sound versus spatial language
Roberta L Klatzky1, James R Marston, Nicholas A Giudice
1Department of Psychology, Carnegie Mellon University, Pittsburgh, PA 15213, USA. klatzky@cmu.edu
Journal of Experimental Psychology. Applied
|December 13, 2006
Summary
Virtual sound cues improve navigation performance under cognitive load, outperforming spatial language. This finding is crucial for developing better guidance systems for the visually impaired.
Area of Science:
- Human-Computer Interaction
- Cognitive Psychology
- Haptics and Auditory Displays
Background:
- Navigation often involves cognitive load, requiring processing of environmental information.
- Current guidance systems may not optimally reduce cognitive burden during complex navigation tasks.
- Auditory and linguistic cues are common methods for providing navigational information.
Purpose of the Study:
- To compare the effectiveness of virtual sound versus spatial language for navigation guidance under cognitive load.
- To investigate the impact of cognitive load on navigation performance with different sensory cueing modalities.
- To assess the potential of virtual sound as a superior guidance modality for complex environments.
Main Methods:
- Participants navigated virtual paths while performing a vibrotactile N-back task to induce cognitive load.
- Guidance was provided using either spatial language (e.g., "left," "right") or virtual sound cues.
- Navigation performance was measured by distance traveled and time to complete paths.
Main Results:
- Virtual sound guidance resulted in shorter distances and less time to complete paths compared to spatial language under cognitive load.
- Navigation performance with virtual sound was superior to spatial language during the N-back task.
- No significant difference in performance was observed between guidance modes in the absence of cognitive load.
Conclusions:
- Virtual sound is a more effective navigational aid than spatial language when cognitive load is present.
- Direct perceptual processing of virtual sound cues may reduce cognitive mediation compared to language.
- Findings support the development of virtual sound-based guidance systems for enhanced navigation, particularly for visually impaired individuals.
Related Concept Videos
01:12Visual Agnosia
Visual agnosia is a condition characterized by the inability to recognize visually presented objects despite having normal vision. For instance, a person with visual agnosia can describe the shape and color of an object but cannot identify or name it. This impairment does not affect their visual field, acuity, color vision, brightness discrimination, language, or memory. An example of this condition in a social setting is someone at a dinner party asking for "that silver thing with a round end"...
01:10Higher Mental Functions of the Brain: Language
Language is a system of communication that allows the expression of thoughts, ideas, and feelings. The brain processes language in both hemispheres.
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
Language formation and comprehension take place in the dominant hemisphere. The dominant hemisphere is responsible for understanding the meaning of spoken, written, or sign language, as well as the ability to communicate. For most people, the left hemisphere is the dominant one. The right hemisphere, then, gives tone and emotional context to the...
01:15Depth Perception and Spatial Vision
Depth perception is the ability to perceive objects three-dimensionally. It relies on two types of cues: binocular and monocular. Binocular cues depend on the combination of images from both eyes and how the eyes work together. Since the eyes are in slightly different positions, each eye captures a slightly different image. This disparity between images, known as binocular disparity, helps the brain interpret depth. When the brain compares these images, it determines the distance to an object.
01:27Language and Cognition
Language serves as a bridge between ideas and communication, influencing how individuals perceive and interact with the world. Psychologists have long debated whether language shapes thought or vice versa. This discussion gained grip with Edward Sapir and Benjamin Lee Whorf in the 1940s, who proposed that language determines thought, a concept known as linguistic determinism. They suggested that the vocabulary and structure of a language influence how its speakers think and perceive reality.
01:17Auditory Perception
The auditory system is essential for sound perception, utilizing various critical structures. When sound waves enter the outer ear, they travel through the ear canal and cause the eardrum to vibrate. These vibrations are then transmitted to the middle ear, where three tiny bones – the malleus, incus, and stapes – amplify the sound. This amplification is crucial, as it ensures that the sound vibrations are strong enough to be conveyed to the inner ear. These vibrations then reach the cochlea, a...
01:21Perceiving Loudness, Pitch, and Location
The human brain perceives pitch through two primary mechanisms reflected in place theory and frequency theory. Each mechanism describes how sound waves are interpreted as specific pitches by the brain, offering insights into the intricate processes of auditory perception.
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...
Place theory, or place coding, suggests that different pitches are heard because various sound waves activate specific locations along the cochlea's basilar membrane. The brain determines the pitch of a sound by identifying...