Related Experiment Videos
A meta-evaluation of 11 school-based smoking prevention programs
Lynne R Tingle1, Marie DeSimone, Benjamin Covington
1Dept. of Educational Research Methodology, University of North Carolina at Greensboro, 1000 Spring Garden St., Greensboro, NC 27402, USA. lrtingle@uncg.edu
The Journal of School Health
|March 20, 2003
Summary
This meta-evaluation of school smoking prevention programs found research design and statistical analysis were strong. However, reliability and validity measures require improvement for better program evaluation.
Area of Science:
- Public Health
- Program Evaluation
- Adolescent Health
Background:
- School-based smoking prevention programs are crucial for public health.
- Evaluating program effectiveness requires rigorous methodological standards.
- Previous evaluations have varied in quality and scope.
Purpose of the Study:
- To conduct a meta-evaluation of eleven school-based smoking prevention programs.
- To assess the methodological rigor of these programs using defined criteria.
- To identify strengths and weaknesses in program evaluation practices.
Main Methods:
- A meta-evaluation framework was applied to eleven smoking prevention programs.
- Seven criteria were used: research design, reliability, validity, statistical analysis, effect sizes, attrition, and fidelity.
- A 0-2 rating scale was employed for each criterion.
Main Results:
- Research design and statistical analysis received the highest ratings.
- Reliability and validity criteria received the lowest ratings.
- Other criteria, including attrition and fidelity, scored moderately.
Conclusions:
- School smoking prevention programs often lack robust reliability and validity testing.
- Enhancing evaluation methods, particularly in reliability and validity, is recommended.
- Future research should prioritize comprehensive program evaluations with effect size reporting.