Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
Kendall's Coefficient of Concordance01:20

Kendall's Coefficient of Concordance

Kendall's Coefficient of Concordance (W), also known as Kendall's W, is a non-parametric statistical measure used to assess the agreement or concordance between multiple raters or judges when they rank a set of items. It is often used when you have ordinal data (ranks) and you want to see if there is consistency or consensus among the raters. It is widely applied in research areas such as psychology, medicine, and social sciences, where multiple judges are asked to rank or rate subjects or...
Significance Testing: Overview01:04

Significance Testing: Overview

Significance testing is a set of statistical methods used to test whether a claim about a parameter is valid. In analytical chemistry, significance testing is used primarily to determine whether the difference between two values comes from determinate or random errors. The effect of a particular change in the measurement protocol, analyst, or sample itself can cause a deviation from the expected result. In the case of a suspected deviation/outlier, we need to be able to confirm mathematically...
Spearman's Rank Correlation Test01:20

Spearman's Rank Correlation Test

Spearman's rank correlation test, also known as Spearman's rho, is a nonparametric method for assessing the strength and direction of association between two variables. This test is particularly valuable when the data distribution is unknown or when the assumption of normality does not hold. Named after the English psychologist and statistician Dr. Charles Edward Spearman, it serves as the nonparametric counterpart to Pearson's correlation coefficient.
Spearman's test calculates correlation by...
Multiple Comparison Tests01:13

Multiple Comparison Tests

Multiple comparison test, abbreviated as MCT, is a post hoc analysis generally performed after comparing multiple samples with one or more tests. An MCT will help identify a significantly different sample among multiple samples or a factor among multiple factors.
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Cochran's Q Test01:17

Cochran's Q Test

Cochran's Q Test is a nonparametric statistical test used to determine if there are potential differences in the outcomes of three or more related groups on a binary (yes/no) or dichotomous outcome. It is essentially an extension of the McNemar Test, which is limited to two related samples - Cochran's Q test can handle three or more related samples, making it more versatile in scenarios where subjects are measured under multiple conditions. The test statistic follows a Chi-Square distribution,...

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Relative frequencies of muscle specific kinase antibody myasthenia in 46 centres worldwide.

Brain : a journal of neurology·2026
Same author

Preoperative Management of Patients With Myasthenia Gravis: A Review of the Evidence.

The Canadian journal of neurological sciences. Le journal canadien des sciences neurologiques·2026
Same author

Teaching Clinical Reasoning in Health Care Professions Learners Using AI-Generated Script Concordance Tests: Mixed Methods Formative Evaluation.

JMIR formative research·2025
Same author

Tongue myokymia due to microscopic polyangiitis.

BMJ case reports·2025
Same author

Learning-by-Concordance Approach in Health Professions Education: A Scoping Review.

Perspectives on medical education·2025
Same author

[Clinical reasoning: What can we learn from script theory?]

La Revue de medecine interne·2024

Related Experiment Video

Updated: Jun 3, 2026

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

Script concordance testing: a review of published validity evidence.

Stuart Lubarsky1, Bernard Charlin, David A Cook

  • 1Department of Neurology and Neurosurgery, McGill University, Montreal, Quebec, Canada. stuart.lubarsky@mcgill.ca

Medical Education
|March 16, 2011
PubMed
Summary

The validity of script concordance test (SCT) scores for assessing clinical data interpretation under uncertainty is generally supported. Further research is needed to verify specifics across contexts and explore educational impacts.

More Related Videos

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

Related Experiment Videos

Last Updated: Jun 3, 2026

Advancing Dyslexia Assessment in Children Through Computerized Testing
09:00

Advancing Dyslexia Assessment in Children Through Computerized Testing

Published on: August 16, 2024

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing
15:00

A Tablet-Based Curriculum-Based Measurement Protocol for Kindergarten Writing

Published on: February 7, 2025

Area of Science:

  • Medical Education
  • Assessment Methods
  • Clinical Reasoning

Background:

  • Script concordance tests (SCTs) aim to measure competence in interpreting clinical data amidst uncertainty.
  • The rigorous establishment of validity for inferences drawn from SCT scores remains an area for development.

Purpose of the Study:

  • To construct a structured validity argument for interpreting test scores obtained via the script concordance method.
  • To systematically evaluate the construct validity of the script concordance method.

Main Methods:

  • Conducted a literature search across PubMed, EMBASE, and PsycINFO for script concordance testing articles.
  • Evaluated construct validity using an established framework encompassing five evidence categories: content, response process, internal structure, relations to other variables, and consequences.

Main Results:

  • Content evidence is supported by guidelines for creating authentic, ill-defined scenarios.
  • High internal consistency reliability supports the internal structure of SCT scores.
  • SCT scores show weak correlations with factual knowledge assessments, particularly in advanced learners, and limited support from examinee response processes and educational consequences.

Conclusions:

  • Published research generally supports SCT for assessing clinical data interpretation under uncertainty.
  • Specifics of the validity argument require verification across different contexts and for particular SCTs.
  • Future research should explore SCT's impact on teaching/learning and its integration into comprehensive assessment programs.