An evaluation of the Ontario Rapid Risk Factor Surveillance System

The Rapid Risk Factor Surveillance System (RRFSS) is an ongoing population health survey conducted by a collaborating group of Ontario public health units. This formative evaluation examined the process effectiveness, collaboration, utility and cost-effectiveness of RRFSS during its first year of operation.

An Evaluation Framework was developed with reference to guidelines for evaluation of surveillance systems developed by the World Health Organization and the U.S. Centers for Disease Control and Prevention. The study focussed on evaluable performance areas in a young surveillance system and on information needed to inform stakeholder decisions about future participation and improvement. Data were collected through surveys and interviews of key informants in participating health units, non-participating health units, the survey research house, and the provincial health ministry.

Findings documented early use and dissemination of RRFSS data in health units after less than a year of surveillance system operation, stakeholder perceptions overall of data impact and value, and satisfaction with system functioning. Challenges to effectiveness were documented concerning data analysis, barriers to data use, and sustainability. Performance improvement strategies were identified for survey implementation and supports, data use, system participation, and reduced costs.

In its first year, RRFSS was an effective collaborative method to collect population data for public health program planning and evaluation. The evaluation provided valuable information on use, functioning, effectiveness, strategic issues and areas for improvement in a young surveillance system, created opportunities for stakeholder input into evaluation and planning, and provided a baseline for future evaluations.