Reliability and validity of the School Health Policies and Programs Study 2000 questionnaires

To help assess the quality of the questionnaires developed for the School Health Policies and Programs Study (SHPPS) 2000, the Centers for Disease Control and Prevention (CDC) conducted a data quality substudy in conjunction with SHPPS 2000. The substudy assessed validity of the state- and district-level questionnaires through telephone interviews with a subsample of the original state- and district-level respondents, and the test-retest reliability of the school- and classroom-level questionnaires through computer-assisted repeat interviews with a subsample of the school- and classroom-level respondents. Results indicated that although a few threats to the validity of responses to the state- and district-level questionnaires were identified, the questionnaires generally produced valid data. Among the school- and classroom-level questionnaires, some questions demonstrated poor reliability, but most exhibited moderate or substantial reliability, and some exhibited almost perfect reliability. CDC will use these results to revise the SHPPS 2000 questionnaires and will consider alternative methods of data collection to improve the quality of data collected in future versions of SHPPS.