Agreement or prediction: asking and answering the right question
Related Experiment Video
Updated: Jul 28, 2026

Assessment and Communication for People with Disorders of Consciousness
Published on: August 1, 2017
1Department of Surgical Oncology, National Cancer Centre, 11 Hospital Drive, Singapore 169610.
Introduction:
Measuring agreement and measuring predictive ability are similar but distinct problems. Failure to appreciate the conceptual and practical differences may lead clinical researchers to give the right answer to the wrong question.
Methods:
We illustrate the relation and difference between measuring agreement and predictive ability in a non-technical way. We provide a real example investigating the feasibility of using preoperative breast cancer tumour size measurements to estimate postoperative histological size. The intraclass correlation and R-squared are calculated to ascertain the level of agreement and predictive ability respectively.
Results:
Analysis of agreement and analysis of predictive ability serve different purposes. The optimal solution found in terms of agreement may be different from that found for prediction.
Conclusions:
A careful clarification of the goal of an investigation is important. Using an inappropriate analysis can lead to misleading results, or to results that do not really answer the research question of interest.
Related Concept Videos
Confirmation Biases
Hindsight Biases
Predicting Reaction Outcomes
What is a Hypothesis?
Prediction Intervals
However, the point estimate is most likely not the exact value of the population parameter, but close to it. After calculating point estimates, we construct interval estimates, called confidence intervals or prediction intervals. This prediction interval comprises a range of values unlike the point estimate and is a better predictor of the observed sample value, y.
The...
Cochran's Q Test

