Related Experiment Video
Updated: May 24, 2026
Project-Based Learning Guidelines for Health Sciences Students: An Analysis with Data Mining and Qualitative Techniques
Published on: December 9, 2022
Feasibility of LLM-Assisted Communication Feedback in Simulation-Based Medical Education: A Pilot Study
Mohamed Alhaskir1, Hannah Haven2,3, Michael Langer3,4
1Institute of Med. Informatics, Medical Faculty of RWTH Aachen University, Germany.
Abstract:
The study presents a local large language model pipeline for automated feedback in pediatric simulation-based medical education. The system generates structured reports using the Liverpool Undergraduate Communication Assessment Scale. Four communication simulations were processed and evaluated against human feedback. The model generated structured reports with total scores (mean = 13.9 ± 1.2) comparable to human ratings (mean = 12.8 ± 2.9). Scenario-level analyses indicated variation in some cases but overall reliable performance across simulation runs. The pipeline demonstrated lower inter-rater variability (SD = 0.7-1.7) than human examiners (SD = 1.3-2.9), indicating greater internal consistency. The findings inform a forthcoming prospective evaluation.
