Related Experiment Video
Updated: Apr 25, 2026

Multimedia Battery for Assessment of Cognitive and Basic Skills in Mathematics BM-PROMA
Published on: August 28, 2021
Differential item and test functioning methodology indicated that item response bias was not a substantial cause of
Carlos G Forero1, Núria D Adroher1, Sarah Stewart-Brown2
1CIBER Epidemiología y Salud Pública (CIBERESP), Instituto de Salud Carlos III, Mechor Fernandez de Almagro, 3-5, 28029, Madrid, Spain; Health Services Research Group, IMIM-Institut Hospital del Mar d'Investigacions Mèdiques, Carrer del Doctor Aiguader, 88, PRBB building, 08003 Barcelona, Spain.
Objectives:
Establishing the cross-cultural equivalence of the mental well-being construct, as measured with the Warwick-Edinburg Mental Well-being Scale (WEMWBS), by studying potential construct validity biases in two countries with previously reported score differences.
Study Design And Setting:
We compared the WEMWBS total scores and item responses in Scotland (N = 779) and Catalonia (N = 1,900) general population samples. To assess whether the questionnaire spuriously favored higher scores in Catalonia, we tested for differential item functioning (DIF) by applying ordinal logistic regression on Item Response Theory scores. DIF was tested with likelihood ratio tests and standard effect measures (McFadden Pseudo R(2), >0.13; relative parameter change, >5%), and differential test functioning (DTF) was tested by plotting differences between full-test and purified (i.e., without DIF items) score estimates.
Results:
Catalonia showed higher levels of mental well-being than Scotland (Cohen d = 0.84). Three of 14 WEMWBS items showed small amounts of DIF. DIF did not accrue to DTF, as shown by intraclass correlation coefficient (ICC, 0.999) and case-by-case differences (maximum, 0.12 SD) between total and purified scores. Population differences remained mainly constant across sociodemographics and health outcomes.
Conclusion:
The WEMWBS measures a distinct well-being construct that is stable across countries, implying that Scotland and Catalonia populations are effectively different in the distribution of mental well-being. This result adds to previous psychometric information and supports WEMWBS as a valid unbiased measures for individual and cross-cultural comparisons.
Related Concept Videos
Self-Serving Bias
Self-Report Tests of Personality
Self-Discrepancy and Its Effects
Traits, Mood, and Subjective Wellbeing
Neuroticism and...
Correspondence Bias
Self-Esteem and Culture
