Related Experiment Videos
Test-Retest Reliability and Mode Effects on Single-Item and Multi-Item Measures in a Survey of Adolescent and Young
Salene M W Jones1, Theresa H M Keegan2, Erin E Hahn3
1Public Health Sciences Division, Fred Hutchinson Cancer Center, Seattle, Washington, USA.
Purpose:
This project examined test-retest reliability and survey mode administration across single-item and multi-item measures among adolescent and young adult (AYA) cancer survivors.
Methods:
Forty-six AYAs randomly assigned to survey mode (phone, online, and paper) completed the survey and were invited to complete the survey again 1 week later.
Results:
Mode effects were found on 6% of single-items and 25% of multi-item scores. Reliability was low for 52% of single-items and 8% of multi-item scores.
Conclusion:
Multi-item measures should generally be used over single-item measures due to better reliability, but single-item measures may be preferable when mode effects are large.
Related Concept Videos
Reliability and Validity
Longitudinal Research
Self-Report Tests of Personality
Comparing the Survival Analysis of Two or More Groups
Cancer Survival Analysis
Cochran's Q Test