Related Experiment Video
Updated: Jun 23, 2026

Advancing Dyslexia Assessment in Children Through Computerized Testing
Published on: August 16, 2024
A method of bias correction for maximal reliability with dichotomous measures
1The University of New South Wales, Sydney, Australia. s.penev@unsw.edu.au
Abstract:
This paper is concerned with the reliability of weighted combinations of a given set of dichotomous measures. Maximal reliability for such measures has been discussed in the past, but the pertinent estimator exhibits a considerable bias and mean squared error for moderate sample sizes. We examine this bias, propose a procedure for bias correction, and develop a more accurate asymptotic confidence interval for the resulting estimator. In most empirically relevant cases, the bias correction and mean squared error correction can be performed simultaneously. We propose an approximate (asymptotic) confidence interval for the maximal reliability coefficient, discuss the implementation of this estimator, and investigate the mean squared error of the associated asymptotic approximation. We illustrate the proposed methods using a numerical example.
Related Concept Videos
Bias in Epidemiological Studies
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Friedman Two-way Analysis of Variance by Ranks
Cochran's Q Test
Odds Ratio