Related Experiment Video
Updated: Jun 30, 2025

Use of a Video Scoring Anchor for Rapid Serial Assessment of Social Communication in Toddlers
Published on: March 14, 2018
Reliability of the 2021 National Youth Risk Behavior Survey Questionnaire
Sherry Everett Jones1, Nancy D Brener1, Barbara Queen2
1Division of Adolescent and School Health, National Center for HIV, Viral Hepatitis, STD, and TB Prevention, Centers for Disease Control and Prevention, Atlanta, GA, USA.
Purpose:
The Youth Risk Behavior Survey (YRBS) monitors behaviors, experiences, and conditions affecting the health of high school students nationwide. This study examined the test-retest reliability of the 2021 national YRBS questionnaire.
Design:
Respondents completed a Time 1 and Time 2 paper-and-pencil questionnaire approximately 2 weeks apart during February to May 2022. Data were linked in such a way as to preserve anonymity.
Setting:
Convenience sample of high schools.
Subjects:
High school students (N = 588).
Measures:
Health risk behaviors and experiences assessed on the 2021 national YRBS questionnaire.
Analysis:
Time 1 and Time 2 responses were compared for each questionnaire item using the McNemar's test. Then, Cohen's kappa coefficients tested the agreement between Time 1 and Time 2 responses overall, and by sex, grade, and Black, White, and Hispanic race and ethnicity.
Results:
Among the 74 items analyzed, 96% had at least moderate reliability, and 73% had substantial or almost perfect reliability. The mean Cohen's kappa was .68. McNemar's test findings showed Time 1 and Time 2 data significantly differed (P < .01) for 9 items (12%).
Conclusion:
Reliable health behavior measures are important in the development of youth-focused public health programs and policies. Findings suggest the national YRBS questionnaire is a reliable instrument. Such findings lend support to relying on adolescent self-reported data when monitoring health behaviors using the YRBS.
Related Concept Videos
Reliability and Validity
Surveys
Data Collection by Survey
Self-Report Tests of Personality
Types of Surveys
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...

