Related Experiment Video
Updated: May 15, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Insights into an Interdisciplinary Digital Medicine Course: A NKLM-Based Evaluation Under Application of the
Annabelle Mielitz1, Hendrik Friederichs2, Anja Bittner3
1Department of Digital Medicine, Medical School OWL, Bielefeld University, Bielefeld, Germany.
Abstract:
Bielefeld University's "Digital Medicine" course enables students to design digital healthcare applications. This study evaluates the 2024 course using items from the German National Competency-Based Catalog of Learning Objectives (NKLM) and the Aggregated Performance Gain (APG) method, its first published use in German digital medicine education evaluations. While 2024 showed lower overall learning gains compared to 2023 with improvements in 6 out of 19 items (vs. 14 out of 17 in 2023), relevant gains were noted in NKLM-related goals, improving in 9 of 11 items. Results are limited by the small sample size, affecting interpretability and generalizability.

