Exact interval estimators for some commonly used measures of binary agreement

We develop exact interval estimators for some commonly used classical measures of agreement in binary responses. We apply Monte Carlo simulation to evaluate the performance of these estimators. When the measure of agreement is homogeneous, we note that extending the results presented here to accommodate stratified analysis is straightforward. We use the data taken from a survey studying the agreement of religious identifications and the data taken from a study assessing the diagnostic performance of Whooley questions for major depression disorder to illustrate the use of these interval estimators.