Assessing interrater agreement from dependent data
Related Experiment Video
Updated: Nov 1, 2026

Nest Building Behavior as an Early Indicator of Behavioral Deficits in Mice
Published on: October 19, 2019
J M Williamson1, A K Manatunga
1Division of HIV/AIDS (E-48), Centers for Disease Control and Prevention, Atlanta, Georgia 30333, USA.
Abstract:
Estimation of interrater agreement for ordered categorical data is examined when the same sample is being assessed by various raters with different methods. We investigate the use of a latent model proposed by Qu, Piedmonte, and Medendorp (1995, Biomerics 51, 268-275) to estimate the correlation between raters for each method, and test for their equality. For each of the assessment methods, these correlations can be interpreted as the variance components of random effects representing subject and rater. This method is applied to an HIV study, in which the amount of ectopy on a woman's cervix is measured by both direct visual assessment and a computer planimetry method.
Related Concept Videos
Kendall's Coefficient of Concordance
Introduction to Test of Independence
The test statistic for a test of independence is similar to that of a goodness-of-fit test:
Variation
When independent and dependent variables are plotted on a scatter plot, the slope of a line is a value that describes the rate of change between the two...
Coefficient of Correlation
If you suspect a linear relationship between x and y, then r can measure how strong the linear relationship is.
What the VALUE of r tells us:
The value of r is always between –1 and +1: –1 ≤ r ≤ 1.
The size of the correlation r indicates the strength of the linear...
Group Design
Multiple Regression
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...