Jove
Visualize
Contact Us
JoVE
x logofacebook logolinkedin logoyoutube logo
ABOUT JoVE
OverviewLeadershipBlogJoVE Help Center
AUTHORS
Publishing ProcessEditorial BoardScope & PoliciesPeer ReviewFAQSubmit
LIBRARIANS
TestimonialsSubscriptionsAccessResourcesLibrary Advisory BoardFAQ
RESEARCH
JoVE JournalMethods CollectionsJoVE Encyclopedia of ExperimentsArchive
EDUCATION
JoVE CoreJoVE BusinessJoVE Science EducationJoVE Lab ManualFaculty Resource CenterFaculty Site
Terms & Conditions of Use
Privacy Policy
Policies

Related Concept Videos

Reliability and Validity01:29

Reliability and Validity

14.4K
Reliability and validity are two important considerations that must be made with any type of data collection. Reliability refers to the ability to consistently produce a given result. In the context of psychological research, this would mean that any instruments or tools used to collect data do so in consistent, reproducible ways.
14.4K

You might also read

Related Articles

Articles linked to this work by shared authors, journal, and citation graph.

Sort by
Same author

Epilepsy characteristics and outcomes in patients with pleomorphic xanthoastrocytomas.

Journal of neuro-oncology·2026
Same author

Creation of a Merged Harmonized Large Database of Subject-Level Data from Acute Secondary Prevention Studies in Minor Non-Cardioembolic Stroke or TIA.

International journal of cerebrovascular disease and stroke·2026
Same author

Phase 1 evaluation of patients with newly diagnosed glioblastoma treated with radiation, nivolumab, and IDO1 enzyme inhibitor BMS-986205.

Clinical cancer research : an official journal of the American Association for Cancer Research·2026
Same author

Theoretical Cost-Effectiveness of PCSK9 Inhibitors in Stroke Due to Intracranial Atherosclerosis.

JAMA network open·2026
Same author

Cost Effectiveness of Endovascular Thrombectomy for Large Ischemic Strokes: A US Healthcare Payer Markov Model Informed by Randomized Trials.

Applied health economics and health policy·2026
Same author

Survival and function in elderly patients with GBM: the role of surgical resection with contemporary multimodal therapy.

Journal of neuro-oncology·2026

Related Experiment Video

Updated: Apr 1, 2026

Assessing Primary Motor Cortex Excitability and Excitability Modulation by Pairing Transcranial Magnetic Stimulation with Electromyography
12:13

Assessing Primary Motor Cortex Excitability and Excitability Modulation by Pairing Transcranial Magnetic Stimulation with Electromyography

Published on: October 7, 2025

851

Neurology objective structured clinical examination reliability using generalizability theory.

Angela D Blood1, Yoon Soo Park2, Rimas V Lukas2

  • 1From Rush University Medical College (A.D.B.); Department of Medical Education (Y.S.P.), The University of Illinois at Chicago; and Department of Neurology (R.V.L., J.R.B.), The University of Chicago, IL. angela_blood@rush.edu.

Neurology
|October 4, 2015
PubMed
Summary

Generalizability theory (G theory) analysis of the neurology objective structured clinical examination (OSCE) shows moderate reliability. Increasing to 3 OSCE cases is recommended to enhance score consistency for medical students.

More Related Videos

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data
14:27

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data

Published on: June 26, 2013

16.5K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.4K

Related Experiment Videos

Last Updated: Apr 1, 2026

Assessing Primary Motor Cortex Excitability and Excitability Modulation by Pairing Transcranial Magnetic Stimulation with Electromyography
12:13

Assessing Primary Motor Cortex Excitability and Excitability Modulation by Pairing Transcranial Magnetic Stimulation with Electromyography

Published on: October 7, 2025

851
Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data
14:27

Identification of Disease-related Spatial Covariance Patterns using Neuroimaging Data

Published on: June 26, 2013

16.5K
Basics of Multivariate Analysis in Neuroimaging Data
06:35

Basics of Multivariate Analysis in Neuroimaging Data

Published on: July 24, 2010

17.4K

Area of Science:

  • Medical Education
  • Psychometrics
  • Neurology Assessment

Background:

  • Objective Structured Clinical Examinations (OSCEs) are crucial for assessing clinical skills in medical education.
  • Ensuring the reliability and validity of OSCE scores is essential for accurate student evaluation.
  • Generalizability theory (G theory) offers a robust framework for analyzing the sources of variance in assessment scores.

Purpose of the Study:

  • To evaluate the reliability of a neurology OSCE using generalizability theory (G theory).
  • To identify factors contributing to score variance in the neurology OSCE.
  • To determine the optimal number of cases for achieving reliable assessment scores.

Main Methods:

  • A multistation OSCE was administered to 194 medical students completing a neurology clerkship.
  • Generalizability theory (G theory) was applied to analyze variance components related to cases, domains, and items.
  • Reliability coefficients (Φ and G) were calculated, and projections were made for score consistency.

Main Results:

  • The neurology OSCE demonstrated moderate reliability (Φ = 0.61, G = 0.64).
  • Score variance was primarily attributed to the assessed domain, not the specific case.
  • A minimum of 3 OSCE cases is projected to be necessary to achieve a reliability threshold above 0.70.

Conclusions:

  • Generalizability theory (G theory) provides valuable insights into the measurement characteristics of the neurology OSCE.
  • Unlike findings in other specialties, OSCE case assignment did not significantly impact student scores; domain variation was the key factor.
  • The study highlights the importance of domain design in ensuring reliable OSCE assessments in neurology.