Rater Reliability: A Maximum Likelihood Confirmatory Factor-Analytic Approach
Abstract:
A procedure for evaluating a variety of rater reliability models is presented. A multivariate linear model is utilized to describe and assess a set of ratings. The parameters of such a model are reexpressed in terms of a factor-analytic model. Maximum likelihood methods are employed to estimate and test the parameters in this factor-analytic model. The approach is related to the use of the intraclass correlation coefficient to estimate reliability. Two examples are presented, and the results contrasted to those found with an intraclass correlation approach. Extensions of the procedure to multiple sets of judges, multiple measures, and multiple groups is introduced.
More Related Videos
Related Concept Videos
Reliability and Validity
Factorial Design
Response Surface Methodology
The process of RSM involves several key steps:
Friedman Two-way Analysis of Variance by Ranks
Theory of Attribution I: Correspondent Inference Theory
Theory of Attribution II: Kelley's Covariation Theory


