Related Experiment Video
Updated: Jun 27, 2026
Haptic/Graphic Rehabilitation: Integrating a Robot into a Virtual Environment Library and Applying it to Stroke Therapy
Published on: August 8, 2011
Gaze and hand behaviors during haptic abilities testing-An update to multimedia learning theory
Michelle A Sveistrup1, Jean Langlois2, Timothy D Wilson1
1The Corps for Research of Instructional and Perceptual Technologies (CRIPT) Laboratory, Department of Anatomy and Cell Biology, Schulich School of Medicine and Dentistry, Western University, London, Ontario, Canada.
Haptic feedback, a third sensory channel, enhances learning for individuals with lower spatial abilities by improving cognitive performance. This expands the Cognitive Theory of Multimedia Learning (CTML) to include tactile input for experiential learning.
Area of Science:
- Cognitive Psychology
- Human-Computer Interaction
- Educational Technology
Background:
- The Cognitive Theory of Multimedia Learning (CTML) traditionally focuses on visual and auditory sensory channels.
- Haptic feedback represents a potential third sensory channel, crucial for developing experiential learning models.
- Previous research has not fully integrated haptic sensory input into CTML frameworks.
Purpose of the Study:
- To investigate and quantify visual and haptic behaviors during spatial tasks.
- To determine how haptic feedback influences learning and cognitive strategies in individuals with varying spatial abilities.
- To explore the role of haptics as a third sensory input channel within the CTML.
Main Methods:
- Participants (n=22) were categorized into high spatial ability (HSA) and low spatial ability (LSA) groups based on the Mental Rotation Test (MRT).
- The Haptic Abilities Test (HAT) was administered under three conditions: sight (S), haptics (H), and sight with haptics (SH).
- Behavioral data, including gaze and hand movements, were recorded and analyzed, comparing HSA and LSA groups across HAT conditions.
Main Results:
- In sight-only (S) conditions, the HSA group fixated less on erroneous visual cues compared to the LSA group (p=0.020).
- Under haptic (H) conditions, the HSA group used palpation less frequently than the LSA group (p=0.022), indicating different tactile strategy utilization.
- Low spatial ability individuals demonstrated benefit from haptic input, employing strategies beyond the standard CTML model.
Conclusions:
- Haptic sensory input can serve as a third channel, augmenting visual and auditory pathways in learning.
- Individuals with lower spatial abilities particularly benefit from haptic feedback, suggesting its potential to improve cognitive performance.
- These findings support the expansion of CTML to incorporate haptic feedback for more comprehensive experiential learning.
