Effect of improving the usability of an e-learning resource: a randomized trial

Area of Science:

• Medical Education
• Human-Computer Interaction
• Educational Technology

Background:

• Optimizing e-learning usability is crucial for reducing cognitive load and maximizing educational impact.
• Usability is often overlooked in e-learning development due to resource constraints.
• Effective e-learning requires a focus on user experience to enhance learning outcomes.

Purpose of the Study:

• To investigate if usability evaluation and subsequent redesign of a multimedia e-learning resource improve usability and learning outcomes.
• To compare two versions of an e-learning resource (V1 and V2) in a randomized trial with medical residents.
• To assess the impact of usability improvements on user satisfaction, interaction, and knowledge acquisition.

Main Methods:

• A randomized trial comparing two versions (V1 and V2) of a multimedia e-learning resource.
• Usability evaluation through user satisfaction questionnaires and analysis of user interactions.
• Learning assessment via knowledge retention and transfer tests.

Main Results:

• High user satisfaction reported for both versions, with good System Usability Scale ratings.
• Significant reduction in serious usability problems in V2 compared to V1, particularly in interactive simulations (P < 0.001).
• No significant differences in knowledge retention or transfer tests between the two versions.

Conclusions:

• Usability evaluation and redesign led to substantial improvements in the e-learning resource's usability.
• Enhanced usability is likely to increase learner motivation and engagement with educational materials.
• While usability improved, direct learning gains were not observed in this study population of highly knowledgeable participants.