Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Nursing Clinical Information System01:27

Nursing Clinical Information System

Nursing Clinical Information System (NCIS)
A Nursing Clinical Information System (NCIS) is a specialized type of healthcare information system tailored to meet the unique needs of nursing practice. It incorporates the principles of nursing informatics to streamline information management and improve the quality of care delivery.
Critical attributes of NCIS include:
Health Literacy01:21

Health Literacy

Health literacy is an individual's or a community's capacity to comprehend, receive, read, and use relevant healthcare information and services. The World Health Organization (WHO, 2018) defines health literacy as the cognitive and social skills that determine the ability of individuals to gain access to, understand, and use information in ways that promote and maintain good health. As a result, the WHO helps individuals manage long-term health concerns, participate in preventative programs,...
ER Retrieval Pathway01:45

ER Retrieval Pathway

In the secretory pathway, vesicles transport proteins from one cellular compartment to another in forward transport to deliver the protein to its correct location. Occasionally, misfolded proteins and incorrect proteins escape their original compartments, and a retrieval pathway is used to return the escaped proteins to their original compartment.
The ER uses many checkpoints to prevent the entry of incorrectly folded or a resident protein as cargo onto a transport vesicle. These mechanisms...
Healthcare Associated Infections I: Iatrogenic, Exogenic and Endogenic01:26

Healthcare Associated Infections I: Iatrogenic, Exogenic and Endogenic

Healthcare-associated infections (HAIs) occur in a healthcare facility while a person receives care for another ailment. This category also includes work-related infections among healthcare staff.
HAIs significantly increase the cost of health care. Extended stays in healthcare institutions, increased disability, increased costs of medications, including specialized antibiotics, and prolonged recovery times add to the patient's expenses and the healthcare institution and funding bodies. Common...
Genetic Lingo01:11

Genetic Lingo

Overview
The Availability Heuristic01:08

The Availability Heuristic

A heuristic is a general problem-solving framework (Tversky & Kahneman, 1974). You can think of these as mental shortcuts that are used to solve problems. Different types of heuristics are used in different types of situations, and the impulse to use a heuristic occurs when one of five conditions is met (Pratkanis, 1989):

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models.

Studies in health technology and informatics·2026
Same author

Agent-Based Improvement of Multiple-Choice Question Quality in Medical Education.

Studies in health technology and informatics·2026
Same author

Cross-Site Generalization of CNN-Based <math><semantics><mrow><msubsup><mi>B</mi> <mn>1</mn> <mo>+</mo></msubsup></mrow> <annotation>$$ {B}_1^{+} $$</annotation></semantics></math> Mapping in UHF MRI.

NMR in biomedicine·2026
Same author

Streamlining and Accelerating the Molecular Tumor Board Process at the University Medical Center Hamburg-Eppendorf.

Targeted oncology·2025
Same author

Open-Source Synthetic Data Generation of Clinical Routine Data.

Studies in health technology and informatics·2025
Same author

Macromolecule Modelling for Improved Metabolite Quantification Using Short Echo Time Brain <sup>1</sup>H-MRS at 3 T and 7 T: The PRaMM Model.

NMR in biomedicine·2024
Same journal

A GenAI Pipeline for Violinist Kinematic Data Management.

Studies in health technology and informatics·2026
Same journal

AMAL-For-Qatar: A Comprehensive AI Ecosystem for Fetal Ultrasound Analysis - Project Overview and Achievements.

Studies in health technology and informatics·2026
Same journal

Longitudinal Treatment-Aware Multimodal AI for Dermatology: A Scoping Review.

Studies in health technology and informatics·2026
Same journal

Predicting Postpartum Depression Using Imbalance-Aware Machine Learning.

Studies in health technology and informatics·2026
Same journal

Validation of Deep-Learning Models for Autosegmentation of Brain Metastases.

Studies in health technology and informatics·2026
Same journal

Delay-Dependent Gating in Modular RNNs.

Studies in health technology and informatics·2026
See all related articles

Related Experiment Video

Updated: May 24, 2026

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

Garbage In, Garbage Out: Context Engineering for Generating Multiple-Choice Questions for Medical Education Using

Michael Grössler1, Layla Tabea Riemann1

  • 1Institute for Applied Medical Informatics, University Medical Center Hamburg-Eppendorf (UKE), Germany.

Studies in Health Technology and Informatics
|May 23, 2026
PubMed
Summary
This summary is machine-generated.

Generating automated medical education questions is hard. A new platform using a Knowledge Graph (KG) significantly improved the quality of multiple-choice questions (MCQs) compared to unstructured text.

Keywords:
Context EngineeringKnowledge GraphsLarge Language Models (LLMs)Medical EducationMultiple-Choice Questions

More Related Videos

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Related Experiment Videos

Last Updated: May 24, 2026

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

Area of Science:

  • Medical Education Technology
  • Artificial Intelligence in Education
  • Knowledge Representation

Background:

  • Automated generation of high-quality multiple-choice questions (MCQs) for medical education is a persistent challenge.
  • Existing methods often struggle with contextual accuracy and relevance.

Purpose of the Study:

  • To develop and evaluate KiMED, a novel platform for automated MCQ generation in German.
  • To enhance MCQ quality by integrating Knowledge Graph (KG)-assisted retrieval with large language models (LLMs).

Main Methods:

  • Biochemistry course materials were processed to construct a KG, extracting entities, properties, and relationships.
  • A multi-agent system utilized the KG to generate MCQs, including question stems, correct answers (keys), and incorrect answers (distractors).
  • LLM-based generation was enhanced by KG-assisted retrieval for precise, contextually relevant information.

Main Results:

  • The constructed KG accurately represented 87% of entities and 82% of relationships from the source material.
  • MCQs generated using the KG approach achieved a 45% usability rate among experts.
  • MCQs generated from unstructured text showed a significantly lower usability rate of 23%.

Conclusions:

  • Structured context, particularly through KGs, substantially improves the quality of automatically generated MCQs.
  • Further optimization of context, agent workflows, and post-processing is necessary for reliable automated question generation.