Related Experiment Videos
Measurement validity: essential in principle, subordinated in practice
1Measurement, Evaluation, and Research Methodology (MERM) Program, Department of ECPS, University of British Columbia, Vancouver, B.C., Canada. bruno.zumbo@ubc.ca.
Abstract:
Quality-of-life and health outcomes research relies on assessment instruments, such as self-report surveys and patient-reported outcome measures, to assess respondents' standing on latent psychological attributes and experiences, such as pain, fatigue, stress, emotional well-being, social participation, and perceived quality of life. Unlike physiological measures, which record bodily states through calibrated procedures, these instruments are used to infer respondents' standing on these attributes through respondents' interpretations of items, response options, and lived experience. Nevertheless, researchers often treat measurement validation of scores from these instruments as a routine psychometric step rather than as an argument for score-based interpretations and decisions. Motivated by recent papers by Hawkins et al. [1] and Gill et al. [2] in Quality of Life Research, it is argued that validity resides not in instruments themselves but in the evidential warrant for interpreting and using scores in specified contexts. Results of investigations of reliability, factor structure, and correlations can support this warrant. However, they cannot explain the meaning of the score or justify their use on their own. Argument-based validation requires researchers to specify interpretations, uses, assumptions, and relevant evidence, including consequences-especially when measures cross languages, cultures, populations, service systems, and policy contexts.
Related Concept Videos
Measures of Intelligence
Validity refers to how well a test measures what it claims to measure. An intelligence test should accurately assess intelligence rather than another characteristic, like anxiety. Criterion validity is one way to evaluate this; it...
Reliability and Validity
Data Validation
Key parameters for method validation include:
Ordinal Level of Measurement
Data measured using an ordinal scale are similar to nominal scale data, but there is one major difference. The ordinal scale data can be ordered. An example of ordinal scale data is a list of the top five national parks in the...
Uncertainty in Measurement: Accuracy and Precision
Nominal Level of Measurement
The data that cannot be measured but can be grouped into categories fall under the nominal level of measurement. Data that is measured using a nominal scale is...