Related Experiment Video
Updated: Sep 8, 2025
Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
Published on: March 14, 2018
Why Questionnaire Scores Are Not Measures: A Question-Raising Article
Luigi Tesio1, Stefano Scarano, Samah Hassan
1From the Department of Biomedical Sciences for Health, Università degli Studi di Milano, Milan, Italy (LT, SS); Istituto Auxologico Italiano, IRCCS, Department of Neurorehabilitation Sciences, Ospedale San Luca, Milan, Italy (LT, SS, AC); Division of Physical Medicine and Rehabilitation, Department of Medicine, University of Toronto, Toronto, Canada (SH, DK); and Pain Research Institute, Toronto Rehabilitation Institute, University Health Network, Toronto, Canada (SH, DK).
This study highlights flaws in traditional questionnaire scoring for measuring latent variables in physical and rehabilitation medicine. It advocates for modern item response theory, specifically Rasch analysis, for more accurate outcome assessment.
Area of Science:
- Measurement in Health Sciences
- Rehabilitation Medicine
- Psychometrics
Background:
- Physical and rehabilitation medicine often assesses unobservable latent variables (e.g., pain, depression, skills).
- These variables are typically measured using questionnaires that sum behavioral items into raw scores.
- Current questionnaire scoring methods can be a flawed approximation of true measures.
Purpose of the Study:
- To summarize the inherent flaws in traditional questionnaire scoring for latent variables.
- To highlight the consequences of these flaws in outcome assessment.
- To promote the adoption of modern item response theory, particularly Rasch analysis.
Main Methods:
- Critical review of existing questionnaire scoring methodologies.
- Analysis of measurement axioms in physical sciences and their application to health measures.
- Discussion of item response theory (IRT) and Rasch analysis as advanced measurement tools.
Main Results:
- Traditional questionnaire scores often fail to meet scientific measurement standards.
- Inaccurate measurement can lead to misleading conclusions in outcome assessment.
- Item response theory provides a more robust framework for measuring latent variables.
Conclusions:
- Questionnaire-based raw scores present significant limitations for accurate measurement of latent variables.
- A critical evaluation of measurement tools is essential in physical and rehabilitation medicine.
- Rasch analysis and modern IRT offer superior methods for reliable and valid assessment of health-related constructs.
