Related Experiment Video
Updated: Aug 8, 2025

A Psychophysics Paradigm for the Collection and Analysis of Similarity Judgments
Published on: March 1, 2022
An extension minimal important difference credibility item addressing construct proximity is a reliable alternative
Yuting Wang1, Tahira Devji2, Alonso Carrasco-Labra3
1Department of Health Research Methods, Evidence and Impact, McMaster University, 1280 Main St East, Hamilton, Ontario L8S 4L8, Canada.
Objectives:
Minimal important difference (MID), the smallest change or difference that patients perceive as important, aids interpretation of change in patient-reported outcome measure (PROM) scores. A credibility instrument that assesses the methodological rigor of an anchor-based MID includes one core item addressing the correlation between the PROM and the anchor. However, the majority of MID studies in the literature fail to report the correlation. To address this issue, we extended the anchor-based MID credibility instrument by adding an item addressing construct proximity as an alternative to the correlation item.
Study Design And Setting:
Informed by an MID methodological survey, we added an alternative item-a subjective assessment of similarity of the constructs (i.e., construct proximity) between PROM and anchor-to the correlation item and generated principles for the assessment. We sampled 101 MIDs and analyzed the assessments performed by each pair of raters. By calculating weighted Cohen's kappa, we assessed the reliability of the assessments.
Results:
Construct proximity assessment is based on the anticipated association between the anchor and PROM constructs: the closer the anticipated association, the higher the rating. Our detailed principles address the most frequently used anchors: transition ratings, measures of satisfaction, other PROMs, and clinical measures. The assessments showed acceptable agreement (weighted kappa 0.74, 95% CI 0.55-0.94) between raters.
Conclusion:
In the absence of a reported correlation coefficient, construct proximity assessment provides a useful alternative in the credibility assessment of anchor-based MID estimates.
More Related Videos
09:00Author Spotlight: Validation of SICOLE-R for Assessing Cognitive and Reading Skills in Spanish-Speaking Children and Its Role in Personalized Education
Published on: August 16, 2024
10:26Problem-Solving Before Instruction PS-I: A Protocol for Assessment and Intervention in Students with Different Abilities
Published on: September 11, 2021
Related Concept Videos
Reliability and Validity
Cause and Effect
The Anchoring-and-Adjustment Heuristic
Correlation and Regression
Correlation and Causation
Correlation versus Causation
If the dependent variable increases or decreases when the independent variable increases, there is a positive or negative...
Correlations