Related Experiment Video
Updated: Sep 23, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
Multiple method comparison: statistical model using percentage similarity
Lesley E Scott1, Jacky S Galpin, Deborah K Glencross
1Department of Molecular Medicine and Hematology, Faculty of Health Sciences, University of the Witwatersrand, Johannesburg, South Africa. lesleys@mighty.co.za
Background:
Method comparison typically determines how well two methods agree. This is usually performed using the difference plot model, which measures absolute differences between two methods. This is often not applicable to data with wide ranges of absolute values. An alternative model is introduced that simplifies comparisons specifically for multiple methods compared to a gold standard.
Methods:
The average between a new method and the gold standard is represented as a percentage of the gold standard. This is interpreted as a percentage similarity value and accommodates wide ranges of data. The representation of the percentage similarity values in a histogram format highlights the accuracy and precision of several compared methods to a gold standard. The calculation of a coefficient of variation further defines agreement between methods.
Results:
Percentage similarity histograms of several new methods can be compared to a gold standard simultaneously, and the comparison easily visualized through use of a single 100% similarity reference line drawn common to all plots.
Conclusion:
This simple method of comparison would be particularly useful for multiple method comparison and is especially applicable for centers collating for external quality assessment or assurance programs to demonstrate differences in results between laboratories.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Comparing the Survival Analysis of Two or More Groups
Bonferroni Test
The means of different samples are first paired in all possible combinations.
The null hypothesis of the...
Spearman's Rank Correlation Test
Spearman's test calculates correlation by...
Comparison Tests
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
