Related Experiment Video
Updated: Oct 10, 2025

08:15
Capturing Dynamic Finger Gesturing with High-resolution Surface Electromyography and Computer Vision
Published on: March 28, 2025
827
Design and Implementation of a Gesture-Aided E-Learning Platform
Wolfgang Kremser1, Stefan Kranzinger1, Severin Bernhart1
1Salzburg Research Forschungsgesellschaft m.b.H., Jakob-Haringer-Straße 5, 5020 Salzburg, Austria.
Sensors (Basel, Switzerland)
|December 10, 2021
Summary
Gesture-aided learning (GAL) enhances e-learning by integrating physical gestures with online content. A new platform design facilitates remote GAL lessons, proving effective in a field test for word learning and gesture data collection.
Area of Science:
- Educational Technology
- Human-Computer Interaction
- Cognitive Science
Background:
- Gesture-aided learning (GAL) enhances learning through embodied cognition but is underutilized in e-learning.
- Existing e-learning platforms lack integrated gesture-based learning functionalities.
Purpose of the Study:
- To present a generic system design for an online gesture-aided learning platform.
- To enable remote GAL lessons for planning, administration, and monitoring.
- To validate the system design through a reference implementation and field test.
Main Methods:
- Developed a five-module system for online GAL: planning, administering, and monitoring.
- Created a reference implementation for word learning.
- Conducted a field test with 19 participants using webcam monitoring for gesture accuracy.
Main Results:
- The reference implementation successfully delivered an e-learning experience incorporating GAL elements.
- Participants rated their experience positively, indicating system usability.
- Webcam feeds effectively monitored gesture execution for instructor review.
Conclusions:
- The proposed system design provides a viable framework for integrating GAL into e-learning platforms.
- The platform can be adopted by e-learning designers to enhance educational experiences.
- The system also serves as a tool for collecting and annotating gesture data for research.
Keywords:
e-learninggesture recognitiongesture-aided learningsoftware engineeringsystem designsystem usability scale
