Related Experiment Video
Updated: Feb 26, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Everything all right in method comparison studies?
1Department of Behavioural Sciences and Philosophy, University of Turku, Finland. erkki.alanen@utu.fi
Abstract:
Researchers and clinicians often need to know whether a new method of measurement is equivalent to an established one that is already in use. For this problem, the estimation of limits of agreement advocated by Bland and Altman is a widely used solution. However, this approach ignores two vital issues in method comparisons. First, does the appropriate re-scaling of the test method bring the methods into agreement? Second, independent of lying 'adequately' between the limits of agreement or not, it is important to know whether one method is equal to or better than another. This article proposes an approach and a model, where both these questions will be addressed simultaneously. In this model, the error variation of the standard method stands for 'acceptable' precision in measurements. Accordingly, the between-subject component of the measurements by the standard method will be used as a 'gold standard' against which the properties of the test method will be evaluated. Application of the model is demonstrated using the peak expiratory flow rate data of Bland and Altman.
Related Concept Videos
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Comparing Experimental Results: Student's t-Test
Comparing the Survival Analysis of Two or More Groups
Statistical Methods to Analyze Parametric Data: Student t-Test and Goodness-of-Fit Test
The Student's t-test is a statistical test that examines if there is a statistically significant difference between the means of two groups. This test is instrumental when dealing with...
Group Design

