Related Concept Videos
Reliability and Validity
Self-Report Tests of Personality
Case Studies
Group Design
McNemar's Test
Theory of Attribution II: Kelley's Covariation Theory
You might also read
Related Articles
Articles linked to this work by shared authors, journal, and citation graph.
Comparative 24-month cardiovascular outcomes and biomarker trajectories with semaglutide, empagliflozin, and sitagliptin in people with obesity and type 2 diabetes: a multicenter real-world study.
Pharmacokinetics of a Single Subcutaneous Extended-Release Buprenorphine (Ethiqa XR) in Healthy Beagles.
Accounting for CAT-Induced Dependency in Differential Item Functioning Detection: A Multilevel Modeling Framework.
Related Experiment Video
Updated: May 26, 2026

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics (BM-PROMA)
Published on: August 28, 2021
Generalizability analyses of NBDE Part II.
Tsung-Hsun Tsai1, Chingwei David Shin, Laura M Neumann
1Department of Testing Services, American Dental Association, Chicago, IL 60611, USA. tsait@ada.org
Generalizability theory suggests that increasing the number of cases, rather than items per case, can enhance score reliability for dental licensing exams. Practical constraints like time and cost are crucial considerations.
Area of Science:
- Psychometrics
- Educational Measurement
- Dental Education
Background:
- Assessing score reliability is critical in high-stakes examinations like the National Board Dental Examinations (NBDE).
- Generalizability theory provides a framework for evaluating multifaceted sources of measurement error.
Purpose of the Study:
- To apply generalizability theory to the NBDE Part II.
- To investigate how varying the number of cases and items influences score generalizability.
Main Methods:
- Utilized generalizability theory to analyze item responses from 1,535 dental candidates.
- Defined sources of error and classified measurement conditions.
- Computed error variances and generalizability coefficients under different conditions.
Main Results:
- Increasing the number of cases, with fewer items per case, may yield greater generalizability improvements compared to increasing items per case.
- Identified specific error variances and generalizability coefficients for various measurement conditions.
Conclusions:
- The study provides empirical evidence on optimizing test design for enhanced reliability in dental licensure testing.
- Findings suggest a strategic approach to balancing the number of cases and items for maximum generalizability, considering practical constraints.