Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Data Validation01:03

Data Validation

7.0K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
7.0K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Epidemiological characteristics of amebiasis in Japan from 2001 to 2022.

PloS one·2026
Same author

Association between community medicine rotation duration and general medicine in-training examination scores among second-year resident physicians in Japan: a nationwide cross-sectional study.

BMC medical education·2026
Same author

Psychiatric nurses' clinical decision-making for adults clinically judged to have childhood maltreatment-related attachment difficulties: A qualitative study employing the steps for coding and theorization method.

Japan journal of nursing science : JJNS·2026
Same author

Associations of marital status with well-being and career intentions among medical residents: a national survey in Japan.

Academic medicine : journal of the Association of American Medical Colleges·2026
Same author

Perceived factors in high-quality residency training programs in Japan: a thematic analysis of perspectives from directors of high-performing programs.

Scientific reports·2026
Same author

Online Search Trends on Child Abuse During the COVID-19 Pandemic Using the Most Widely Used Search Engine: Retrospective Observational Study.

JMIR pediatrics and parenting·2026

Related Experiment Video

Updated: Feb 19, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

1.2K

AI- vs Human-Based Assessment of Medical Interview Transcripts in a Generative AI-Simulated Patient System:

Hiromizu Takahashi1, Kiyoshi Shikino2, Takeshi Kondo3,4

  • 1Department of General Medicine, Faculty of Medicine, Juntendo University, 3-1-3 Hongo, Bunkyo Tokyo, 1130033 Japan, Tokyo, Japan, 81 3-3813-3111.

JMIR Medical Education
|February 17, 2026
PubMed
Summary
This summary is machine-generated.

AI-based assessment (ABA) closely matches human-based assessment (HBA) for virtual patient interviews, offering a reliable and faster alternative. This technology can improve efficiency and reduce faculty workload in medical education.

Keywords:
AIChatGPTartificial intelligenceclinical interviewmedical educationsimulation-based learningvirtual patient

More Related Videos

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

1.6K

Related Experiment Videos

Last Updated: Feb 19, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
03:14

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness

Published on: December 6, 2024

1.2K
Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
05:47

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems

Published on: June 13, 2025

1.6K

Area of Science:

  • Medical Education Technology
  • Artificial Intelligence in Healthcare
  • Clinical Skills Assessment

Background:

  • Generative artificial intelligence (AI) is increasingly utilized in medical education for virtual patient simulations.
  • The comparability of AI-based assessment (ABA) with traditional human-based assessment (HBA) for clinical interviews remains underexplored.

Purpose of the Study:

  • To compare the quality of clinical interview assessments from AI (GPT-o1 Pro, GPT-5 Pro) versus human evaluators.
  • To evaluate AI's impact on assessment time and agreement across varying clinical experience levels.

Main Methods:

  • Standardized leg weakness case presented via an AI virtual patient to seven participants.
  • Interview transcripts were scored using the Master Interview Rating Scale by both AI tools and blinded clinical instructors.
  • Reliability and agreement were assessed using correlation coefficients, Bland-Altman analysis, and Cronbach's alpha; time efficiency was measured.

Main Results:

  • AI-based assessment (ABA) scores closely mirrored human-based assessment (HBA) scores (r=0.90, concordance correlation coefficient=0.88).
  • ABA demonstrated superior consistency (lower coefficient of variation: 6.6% vs 13.9%) and reliability (ICC(3,1): 0.77-0.82) compared to HBA (ICC(2,1): 0.38).
  • AI significantly reduced evaluation time, with GPT-5 Pro offering a 67.6% reduction compared to human evaluators.

Conclusions:

  • AI-based assessment provides a valid, consistent, and rapid alternative to human-based assessment for virtual patient interviews.
  • ABA can enhance efficiency, enable timely feedback, and decrease faculty workload in medical training settings.
  • Further research is recommended to confirm the generalizability of ABA across diverse educational contexts.