Related Experiment Video
Updated: Mar 21, 2026
Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
Published on: March 14, 2018
Validity and Reliability of Behavior and Theory-Based Psychosocial Determinants Measures, Using Audience Response
Heewon Lee Gray1, Pamela A Koch1, Isobel R Contento1
1Department of Health and Behavior Studies, Teachers College Columbia University, New York, NY.
Objective:
To examine the validity and reliability of a questionnaire administered with an audience response system (ARS).
Design:
Cross-sectional study.
Setting:
Two New York City public elementary schools.
Participants:
Fourth- and fifth-grade students.
Main Outcome Measures:
A Food, Health, and Choices questionnaire (FHC-Q) assessed energy balance-related behaviors (EBRBs) including intake of fruits and vegetables, sugar-sweetened beverages, processed packaged snacks, and fast food; physical activity; recreational screen time; and associated psychosocial determinants (≥ 3 questions/outcome scale). Previously validated reference instruments were used for relative validation. The ARS format was compared with a paper-and-pencil format. All measures were administered in a classroom setting.
Analysis:
Pearson correlation coefficients between the reference instruments and the FHC-Q were calculated. Internal consistency reliabilities were evaluated with Cronbach α. Spearman rank correlation, intra-class correlation, and percent agreement were used for test-retest reliability between paper-and-pencil and ARS, and between 2 ARS FHC-Q administrations.
Results:
Correlations for EBRBs with reference instruments ranged from 0.38 to 0.61 (P < .01). Cronbach α ranged from .77 to .92 for EBRBs and .74 to .90 for psychosocial determinants. Test-retest reliability correlations ranged from 0.36 to 0.87 (P < .001). Agreement for knowledge questions ranged from 69.8% to 84.8%.
Conclusions And Implications:
The ARS FHC-Q has acceptable validity and reliability for collecting data on EBRBs and associated psychosocial determinants for upper-elementary students.
