Related Experiment Videos
Correction to"Applying multivariate generalizability theory to psychological assessments" by Vispoel et al. (2023)
Abstract:
Reports an error in "Applying multivariate generalizability theory to psychological assessments" by Walter P. Vispoel, Hyeryung Lee, Hyeri Hong and Tingting Chen (Psychological Methods, Advanced Online Publication, Sep 07, 2023, np; see record 2024-05048-001). In the article "Applying Multivariate Generalizability Theory to Psychological Assessments," by Walter P. Vispoel, Hyeryung Lee, Hyeri Hong, and Tingting Chen (Psychological Methods, advance online publication, September 7, 2023, https://doi.org/10.1037/met0000606), the author discovered an error in Equation 38. "Estimated Reliability (Composite)" should have been "Estimated Reliability (Subscale)" in the denominator of the original equation. This change was incorporated into the corrected version, and the equation was further simplified by replacing terms involving true score variances and covariances. The corrected equation is noted in this Erratum. (The following abstract of the original article appeared in record 2024-05048-001.) Multivariate generalizability theory (GT) represents a comprehensive framework for quantifying score consistency, separating multiple sources contributing to measurement error, correcting correlation coefficients for such error, assessing subscale viability, and determining the best ways to change measurement procedures at different levels of score aggregation. Despite such desirable attributes, multivariate GT has rarely been applied when measuring psychological constructs and far less often than univariate techniques that are subsumed within that framework. Our purpose in this tutorial is to describe multivariate GT in a simple way and illustrate how it expands and complements univariate procedures. We begin with a review of univariate GT designs and illustrate how such designs serve as subcomponents of corresponding multivariate designs. Our empirical examples focus primarily on subscale and composite scores for objectively scored measures, but guidelines are provided for applying the same techniques to subjectively scored performance and clinical assessments. We also compare multivariate GT indices of score consistency and measurement error to those obtained using alternative GT-based procedures and across different software packages for analyzing multivariate GT designs. Our online supplemental materials include instruction, code, and output for common multivariate GT designs analyzed using mGENOVA and the gtheory, glmmTMB, lavaan, and related packages in R. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
Related Concept Videos
Theory of Attribution II: Kelley's Covariation Theory
Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...
Reliability and Validity
Psychometric Approach of Cognitive Development
Behavioral Genetics and Its Designs
The primary methodologies used in behavior genetics include family studies, twin studies, and adoption studies, each providing unique...
Theory of Attribution I: Correspondent Inference Theory