Related Experiment Video
Updated: May 24, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Agent-Based Improvement of Multiple-Choice Question Quality in Medical Education
Lilly Marie Düsterbeck1, Michael Grössler1, Graziella Credidio1
1Institute for Applied Medical Informatics, University Medical Center Hamburg-Eppendorf (UKE), Germany.
Abstract:
High-quality multiple-choice questions (MCQs) are essential for medical education, but costly to design. Large language models (LLMs) can generate MCQs automatically, yet their outputs often fail to meet core quality criteria. This paper presents a self-optimizing multi-agent approach that refines LLM-generated MCQs by aligning them with predefined quality standards. Expert evaluation shows significant improvements for question stems, producing clearer and more answerable items. For answer options, however, improvements remain inconsistent. The findings indicate that automated refinement by self-optimizing agents can reduce manual workload for educators and accelerate the creation of high-quality question stems, while highlighting open challenges for future research.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Cochran's Q Test
Methods of Medium Optimization
Health Information Technology and Healthcare Information System
Health Information Technology, commonly called HIT, integrates advanced information systems and technology in healthcare settings. Its primary functions include:
Automated Microbial Diagnostics
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...