Related Experiment Video
Updated: Jun 26, 2026

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
A multivariate hierarchical Bayesian approach to measuring agreement in repeated measurement method comparison
1Accident Research Centre, Monash University, Clayton, Melbourne, Victoria 3800, Australia. philip.schluter@muarc.monash.edu.au
This study introduces flexible Bayesian models for method comparison studies, enhancing Bland-Altman analysis for both validity and reproducibility with repeated measurements. The models handle complex data and provide full parameter uncertainty.
Area of Science:
- Biostatistics
- Medical Statistics
- Data Analysis
Background:
- Method comparison studies require assessing both validity (between-method agreement) and reproducibility (within-method agreement).
- The Bland-Altman limits of agreement is favored for validity but less adopted for reproducibility due to limited statistical tools for repeated measurements.
- Lack of flexible, accessible statistical machinery hinders analysis of repeated measurement method comparison data.
Purpose of the Study:
- To present a statistical framework using Bayesian methods to extend the Bland-Altman approach for assessing both validity and reproducibility in method comparison studies with repeated measurements.
- To provide easily implementable multivariate hierarchical Bayesian models for analyzing complex method comparison data.
Main Methods:
- Developed two multivariate hierarchical Bayesian models based on the Bland-Altman framework.
- Model 1: Assumes static underlying values (exchangeable replicates).
- Model 2: Assumes dynamic underlying values (non-exchangeable replicates) for repeated measurements.
Main Results:
- Illustrated model advantages using two previously analyzed datasets.
- Demonstrated application of both models for static underlying values.
- Showcased the non-exchangeable replicate model for continually changing underlying values.
Conclusions:
- The presented Bayesian models offer a flexible and easily implemented solution for method comparison studies.
- Models allow for full parameter uncertainty, simultaneous method comparison, and handling of unbalanced or missing data.
- Freely available computer code in WinBUGS is provided for analysis.
Related Concept Videos
Multiple Comparison Tests
It would be easy to compare two samples using a significance alpha level of 0.05. In other words, there is only one sample pair to be compared. However, it would be difficult to identify a significantly different sample if the number...
Bioequivalence Experimental Study Designs: Repeated Measures, Cross-Over, Carry-Over, and Latin Square Designs
Multiple Regression
Farmers can use multiple regression to determine the crop yield based on more than one factor, such as water availability, fertilizer, soil properties, etc. Here, the crop yield is the response or dependent variable as it depends on the other independent variables. The analysis requires the construction of a scatter plot...
One-Way ANOVA: Equal Sample Sizes
Different sample means can result in different values for the variance estimate: variance between samples. This is because the variance between samples is calculated as the product of the sample size and the variance between the...
Comparing the Survival Analysis of Two or More Groups
One-Way ANOVA

