Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

212
Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects...
212
Multiple Comparison Tests01:13

Multiple Comparison Tests

3.8K
Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
3.8K
Convergent Evolution01:54

Convergent Evolution

27.3K
Evolution shapes the features of organisms over time, ensuring that they are suited for the environments in which they live. Sometimes, selection pressure leads to the rise of similar but unrelated adaptations in organisms with no recent common ancestors, a process known as convergent evolution.
27.3K
Bonferroni Test01:10

Bonferroni Test

2.7K
The Bonferroni test is a statistical test named after Carlo Emilio Bonferroni, an Italian mathematician best known for Bonferroni inequalities. This statistical test is a type of multiple comparison test to determine which means are different than the rest. Bonferroni test can minimize the Type 1 error by reducing the significance level alpha, which otherwise increases with sample pairs.
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
2.7K
Wilcoxon Signed-Ranks Test for Matched Pairs01:09

Wilcoxon Signed-Ranks Test for Matched Pairs

75
The Wilcoxon signed-rank test for matched pairs evaluates the null hypothesis by combining the ranks of differences with their signs. It essentially tests whether the median of the differences in a population of matched pairs is zero. Since the test incorporates more information than the sign test, it generally yields more trustable conclusions. This test also does not require the data to follow a normal distribution, but two conditions must be met for it to be applicable: (1) the data must...
75
Friedman Two-way Analysis of Variance by Ranks01:21

Friedman Two-way Analysis of Variance by Ranks

130
Friedman's Two-Way Analysis of Variance by Ranks is a nonparametric test designed to identify differences across multiple test attempts when traditional assumptions of normality and equal variances do not apply. Unlike conventional ANOVA, which requires normally distributed data with equal variances, Friedman's test is ideal for ordinal or non-normally distributed data, making it particularly useful for analyzing dependent samples, such as matched subjects over time or repeated measures...
130

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

AI-assisted case builder: Making PBL more scalable and adaptable.

Medical teacher·2026
Same author

Evaluation of the Accuracy of Air-puff Tonometer Compared to Goldmann and Schiotz Tonometers among Egyptians.

Journal of current glaucoma practice·2025
Same author

A digital recipe for enhancing clinical reasoning: the role of e-learning by concordance (E-LbC): a quasi-experimental study.

BMC medical education·2025
Same author

Effect of anterior chamber depth on corneal endothelium following phacoemulsification among patients with different axial lengths.

International ophthalmology·2025
Same author

Using AI to produce problem-based learning cases.

Medical education·2023
Same author

Readiness for Interprofessional Learning Among Students of Four Undergraduate Health Professions Education Programs.

Advances in medical education and practice·2023

Related Experiment Video

Updated: May 23, 2025

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

7.6K

Introducing AI as members of script concordance test expert reference panel: A comparative analysis.

Moataz A Sallam1, Enjy Abouzeid2,3

  • 1Ophthalmology Department, Suez Canal University, Ismailia, Egypt.

Medical Teacher
|March 8, 2025
PubMed
Summary

Artificial intelligence (AI) models can assist in creating Script Concordance Tests (SCTs) for clinical reasoning training. While not replacing human experts, AI enhances efficiency and helps bridge the performance gap for medical students.

Keywords:
ChatGPTClinical reasoningScript concordances testchatbotsgenerative AIo1 preview

More Related Videos

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

385
The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

5.8K

Related Experiment Videos

Last Updated: May 23, 2025

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism
06:15

Using the Visual World Paradigm to Study Sentence Comprehension in Mandarin-Speaking Children with Autism

Published on: October 3, 2018

7.6K
Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody
09:09

Foreign Accent and Forensic Speaker Identification in Voice Lineups: The Influence of Acoustic Features Based on Prosody

Published on: September 27, 2024

385
The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups
14:14

The Innovation Arena: A Method for Comparing Innovative Problem-Solving Across Groups

Published on: May 13, 2022

5.8K

Area of Science:

  • Medical Education
  • Artificial Intelligence in Healthcare
  • Clinical Reasoning Assessment

Background:

  • The Script Concordance Test (SCT) is a valuable tool for assessing clinical reasoning in professional development.
  • Expert Reference Panel (ERP) burnout is a significant challenge in SCT creation.
  • Exploring AI, specifically ChatGPT, as an alternative for ERP membership is crucial for efficiency.

Purpose of the Study:

  • To enhance the efficiency of SCT creation using AI models.
  • To maintain the educational quality of SCTs with AI involvement.
  • To evaluate the effectiveness of different AI models as reference panels compared to human experts.

Main Methods:

  • A quasi-experimental comparative design was used, involving undergraduate medical students and faculty in an Ophthalmology clerkship.
  • Two groups were established: a Traditional ERP (15 human experts) and an AI-Generated ERP (using ChatGPT and o1 preview).
  • AI panels were designed to mirror diverse clinical opinions based on varying experience levels.

Main Results:

  • Human experts generally achieved the highest mean scores on SCT vignettes.
  • AI models (ChatGPT-4 and o1) produced slightly lower scores, with o1 scores being closer to expert performance.
  • Both human experts and AI models demonstrated high consistency and reliability in their ratings.

Conclusions:

  • AI models show promise in augmenting the creation of clinical reasoning assessments.
  • AI can be utilized for training medical students and improving their reasoning skills.
  • AI tools can help reduce the disparity between student and expert performance levels in clinical reasoning.