Related Experiment Video
Updated: Dec 3, 2025

07:12
Development of a Gaze-Contingent Display Framework Designed for Perceptual and Oculomotor Research with Simulated Central Vision Loss
Published on: April 11, 2025
740
Auditory versus visual spatial stimulus-response mappings in tracking and discrete dual task performance:
Steve Ngai Hung Tsang1, Alan Hoi Shou Chan1, Xing Pan2
1Department of Systems Engineering and Engineering Management, City University of Hong Kong, Hong Kong, China.
Ergonomics
|October 26, 2020
Summary
Spatial compatibility significantly impacts dual-task performance. Incompatible stimulus-response mappings increase delays, while cross-modality (auditory-visual) tasks generally outperform intra-modality (visual-visual) tasks for better human-machine system design.
Area of Science:
- Human-Computer Interaction
- Cognitive Psychology
- Ergonomics
Background:
- Investigating dual-task performance is crucial for optimizing human-machine systems.
- Spatial compatibility between stimuli and responses affects cognitive load and task efficiency.
- Understanding modality effects (auditory vs. visual) is key for interface design.
Purpose of the Study:
- To examine how spatial compatibility influences dual-task performance across different display-control configurations.
- To compare performance in cross-modality (auditory-visual) versus intra-modality (visual-visual) tasks.
- To provide practical ergonomics design implications for interface development.
Main Methods:
- A four-choice response task with auditory signals was combined with a joystick-controlled visual tracking task.
- Spatial compatibility was manipulated by varying stimulus-response mappings.
- Dual-task performance was measured by response times and task delays.
Main Results:
- Increased stimulus-response incompatibility led to longer delays in both tasks, attributed to increased stimulus encoding time.
- Cross-modality (auditory-visual) dual tasks showed significantly better performance than intra-modality (visual-visual) tasks.
- When visual tasks were spatially proximate, allowing concurrent ambient and focal vision, intra-modality performance slightly surpassed cross-modality performance.
Conclusions:
- Spatial compatibility is a critical factor in dual-task design, influencing performance through stimulus encoding.
- Cross-modality interfaces can enhance dual-task efficiency, but proximity in intra-modality visual tasks can mitigate this advantage.
- Findings offer valuable ergonomics recommendations for designing more effective human-machine interfaces.

