Related Experiment Video
Updated: Jul 11, 2026

Decomposing the Variance in Reading Comprehension to Reveal the Unique and Common Effects of Language and Decoding
Published on: October 11, 2018
Reliability studies can be designed more efficiently by using variance components estimates from different sources
Anne M Euser1, Saskia le Cessie, Martijn J J Finken
1Department of Clinical Epidemiology, Leiden University Medical Center, Albinusdreef 2, P.O.Box 9600, 2300 RC Leiden, The Netherlands.
Objectives:
Reliability studies are frequently organized within the context of a large (multicenter) study, with only a small sample of subjects measured by the observers of the large study. To estimate interobserver reliability, data from the large study are not frequently used. In this article, the advantages of combining data from the reliability study and the large study to improve the estimation of intra-class correlation coefficients (ICCs) are highlighted.
Study Design And Setting:
This was done within the scope of estimating fat percentages in the Project On Preterm and Small-for-gestational-age infants-19 (POPS-19) study and with simulations. To calculate ICCs, three approaches were used: (1) the classical approach using data from a reliability study only, (2) the combined variances approach using inter-subject variances from the POPS-19 study, and (3) the maximum likelihood approach using all data.
Results:
The ICCs (95% confidence interval [CI]) for fat percentage calculated by the three approaches were 0.84 (0.57, 0.99), 0.94 (0.90, 0.97), and 0.94 (0.88, 0.97), respectively.
Conclusion:
The efficient use of data by combining data from a small reliability study with the data from the large study itself for the calculation of ICCs will lead to more precise ICCs.
More Related Videos
09:18Doppler Ultrasound-Based Leg Blood Flow Assessment During Single-Leg Knee-Extensor Exercise in an Uncontrolled Setting
Published on: December 15, 2023
20:24Characterization of Complex Systems Using the Design of Experiments Approach: Transient Protein Expression in Tobacco as a Case Study
Published on: January 31, 2014
Related Concept Videos
Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...
Statistical Analysis: Overview
One of the most commonly used statistical quantifiers is the mean, which is the ratio between the sum of the numerical values of all results and the...
Reliability and Validity
Variance
What are Estimates?
The estimate for the mean of a sample is denoted by ͞x, whereas the mean of the population is designated as μ. Further, parameters such as the mean,...
Uncertainty in Measurement: Accuracy and Precision