Related Experiment Video
Updated: Jun 12, 2026
13:44
Project-Based Learning Guidelines for Health Sciences Students: An Analysis with Data Mining and Qualitative Techniques
Published on: December 9, 2022
Student Perspective Matters for GenAI in Question Setting in Medical Education
Olivia Ng1, Siew Ping Han1, Lin Anne Chui1
1Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore, Singapore.
Medical Science Educator
|October 20, 2025
Summary
Medical students could not distinguish between artificial intelligence and human-created multiple-choice questions. They opposed using AI-generated questions in assessments without expert review due to concerns about accuracy and relevance.
Area of Science:
- Medical Education
- Artificial Intelligence in Healthcare
- Assessment Methods
Background:
- The integration of Generative Artificial Intelligence (GenAI) into medical education presents novel opportunities and challenges.
- Medical students' perceptions are crucial for the effective and ethical implementation of new assessment technologies.
Purpose of the Study:
- To investigate medical students' ability to differentiate between GenAI-generated and clinician-generated multiple-choice questions (MCQs).
- To explore student perspectives on the use of GenAI-generated MCQs in formal assessments.
Main Methods:
- A survey was administered to 86 MBBS students.
- Participants were asked to differentiate between MCQs generated by ChatGPT and those created by clinical educators.
- Student perceptions regarding the use of GenAI in assessments were collected.
Main Results:
- Students' performance in distinguishing between ChatGPT-set and clinician-set questions was not statistically significant, performing at chance levels (p = 0.46).
- A strong opposition to the use of unvetted GenAI-generated questions was observed among participants.
- Key concerns cited by students included accuracy, relevance, and educational value of AI-generated content.
Conclusions:
- Medical students are unable to reliably differentiate between GenAI-generated and human-expert-generated assessment items.
- The adoption of GenAI in medical assessments necessitates careful consideration of student feedback and the educational validity of the tools.
- Expert vetting and a focus on educational value are paramount for the responsible integration of GenAI in student evaluations.
Related Concept Videos
01:22Case Studies
There are many research methods available to psychologists in their efforts to understand, describe, and explain behavior and the cognitive and biological processes that underlie it.
01:13Patient-centered Care
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...
01:27Ethical Issues
Nurses are essential in patient care, upholding the ethical principles of their profession and effectively navigating ethical dilemmas. Neglecting ethical issues can lead to inadequate patient care, compromised therapeutic relationships, and moral distress among healthcare workers.
Ethical Concerns in Healthcare:
Ethical Concerns in Healthcare:
01:17Assessment of the Gastrointestinal System I: Subjective Data
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems related to...
Health History
The initial step in assessing the GI system is obtaining a comprehensive health history. This includes inquiring about the patient's history or presence of problems related to...
01:29Assessment of the Gastrointestinal System II: Health Perception Pattern
Assessing the gastrointestinal (GI) system is a complex process that begins with collecting subjective data. This data, collected through patient interviews, provides crucial insights into the patient's health history, perception patterns, and lifestyle habits, all contributing significantly to GI health.
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
Health Perception Patterns
Health perception patterns offer valuable insights into a patient's lifestyle habits and how they may impact their GI health. These patterns include:
01:29Pharmacogenetics and Pharmacogenomics: Overview
Pharmacogenetics and pharmacogenomics examine how genetic factors influence an individual's response to drugs. While pharmacogenetics focuses on the impact of specific genetic variants on drug effects, pharmacogenomics takes a broader approach, studying how genetic variation across populations contributes to differences in drug responses. These fields aim to explain why individuals may experience varying levels of efficacy or adverse reactions to the same medication.Variability in drug...