Related Experiment Video
Updated: Dec 7, 2025
Measuring the Functional Abilities of Children Aged 3-6 Years Old with Observational Methods and Computer Tools
Published on: June 20, 2020
Measuring disability: An agreement study between two disability measures
John A Bourke1, Allison Nichols-Dunsmuir2, Annabel Begg2
1Burwood Academy of Independent Living, Private Bag 4708, Christchurch, 8140, New Zealand; Menzies Health Institute, Griffith University, Queensland, 4222, Australia; Preventive and Social Medicine, University of Otago, PO Box 56, Dunedin, 9054, New Zealand.
Background:
The Washington Group Short Set (WGSS) is increasingly being included in surveys worldwide to improve the quality and comparability of disability data within and between nations. However, compared to commonly employed binary impairment measures, the WGSS appears to have a relatively high threshold for disability indication. Empirical evidence is required to quantify this potential difference and its impact.
Objective:
To determine the agreement between a binary disability question (BDQ) and the WGSS measure administered concurrently in a large representative survey of adults. Two WGSS indication scenarios were considered: one using the recommended threshold to indicate disability (WGSS1); and another using a lower threshold (WGSS2).
Methods:
A cross-sectional agreement study nested within the 2018 Canterbury Wellbeing Survey of randomly selected adults aged ≥18 years resident in the greater Christchurch region.
Results:
From 2807 valid observations, 493 (17.6%), 259 (9.1%), and 822 (28.7%) participants were identified as having a disability by the BDQ, WGSS1 and WGSS2 measures, respectively. While concordance was high between BDQ and WGSS1 measures (85.3%), agreement was only fair (κ = 0.37) and discordance was significantly asymmetrical (p < 0.001). Participants were more likely to be indicated as 'disabled' using the BDQ but not indicated using the WGSS1 than vice versa.
Conclusions:
Different WGSS thresholds produce widely varying disability estimates, and the recommended WGSS1 resulted in an importantly reduced disability prevalence compared to a binary impairment measure when administered concurrently. This has profound implications for inclusivity and policy for people living with disability.
