Related Experiment Video
Updated: Jun 30, 2026
13:44
Project-Based Learning Guidelines for Health Sciences Students: An Analysis with Data Mining and Qualitative Techniques
Published on: December 9, 2022
LLM-Generated multiple choice practice quizzes for preclinical medical students.
Troy Camarata1, Lise McCoy2, Robert L Rosenberg3
1Baptist University College of Osteopathic Medicine, Memphis, Tennessee, United States.
Advances in Physiology Education
|June 14, 2025
Summary
Artificial intelligence can create medical exam questions, but expert review is crucial. Large language models show promise for generating practice quizzes when supervised by subject matter experts.
Area of Science:
- Medical Education
- Artificial Intelligence in Education
Background:
- Multiple choice questions (MCQs) are essential for medical education assessment.
- Automated MCQ generation can reduce faculty workload and expand student practice resources.
Purpose of the Study:
- To assess the feasibility of using ChatGPT for generating USMLE/COMLEX-USA-style medical practice questions.
- To evaluate the quality and accuracy of AI-generated medical assessment items.
Main Methods:
- Second-year medical students used ChatGPT-generated renal physiology quizzes.
- Independent experts evaluated question quality against NBME/NBOME guidelines.
Main Results:
- 49% of AI-generated questions had writing flaws; 22% had factual/conceptual errors.
- 91% of questions were deemed suitable as a revision starting point.
Conclusions:
- Large language models (LLMs) are feasible for generating medical education practice questions.
- Expert supervision and training in item writing are essential for effective LLM use in medical assessment.
Keywords:
artificial intelligencelarge language modelmedical educationmultiple choice questionspractice questionsMore Related Videos
Related Concept Videos
02:16Surveys
14.7K
Often, psychologists develop surveys as a means of gathering data. Surveys are lists of questions to be answered by research participants, and can be delivered as paper-and-pencil questionnaires, administered electronically, or conducted verbally. Generally, the survey itself can be completed in a short time, and the ease of administering a survey makes it easy to collect data from a large number of people.
14.7K
01:26Methods of Documentation II: POMR
924
The Problem-Oriented Medical Record (POMR) revolutionized medical record-keeping by introducing a systematic approach focusing on the patient's problems rather than merely listing symptoms. Dr. Lawrence Weed's introduction of this method in the 1960s marked a significant advancement in medical documentation. The POMR framework consists of four key components: the database, problem list, plan of care, and progress notes.
924
01:21Methods of Documentation III: PIE
1.4K
Problem-intervention-evaluation (PIE) is a systematic approach to documentation used in healthcare settings for clinical decision-making and patient care planning. It is a structured approach to organizing patient data based on problems, interventions, and evaluations. Here's a breakdown of its key features and considerations:
1.4K
01:15Systematic Error: Methodological and Sampling Errors
1.4K
In the case of systematic errors, the sources can be identified, and the errors can be subsequently minimized by addressing these sources. According to the source, systematic errors can be divided into sampling, instrumental, methodological, and personal errors.
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
1.4K
01:28Preclinical Development: Overview
4.3K
Preclinical development consists of a series of tests that ensure the safety and efficacy of a new therapeutic compound before it is tested in humans. There are four main phases to this process. First, safety pharmacology tests are conducted to ensure the drug does not produce any acutely harmful effects. These tests examine parameters such as bronchoconstriction, cardiac dysrhythmias, blood pressure changes, and ataxia. Next, preliminary toxicological testing is performed to determine the...
4.3K
01:22Self-Report Tests of Personality
328
Self-report inventories are objective personality assessments that use multiple-choice items or numbered scales, typically ranging from 1 (strongly disagree) to 5 (strongly agree). They are often called Likert scales after Rensis Likert. These inventories are widely used due to their ease of administration and cost-effectiveness. One of the most prominent examples is the Minnesota Multiphasic Personality Inventory (MMPI), initially developed in the 1940s to assess abnormal personality traits.
328