Evaluation for learning and improvement at the right time: an example from the field.

Area of Science:

• Public Health
• Program Evaluation
• Knowledge Translation

Background:

• Non-profit organizations, particularly those in public health programs, often face challenges accessing timely and relevant evaluation expertise for program improvement.
• Program managers require accessible information on program effectiveness and areas for enhancement to optimize implementation.
• The Fred Hollows Foundation's Indigenous Australia Program's Trachoma Elimination Program highlighted the need for better evaluative insights.

Purpose of the Study:

• To describe a collaborative model for designing and implementing utilization-focused evaluations within a non-profit program.
• To integrate developmental evaluation principles and knowledge translation strategies to enhance the practical application of evaluation findings.
• To identify key lessons learned from a collaborative evaluation process in a public health program.

Main Methods:

• A collaborative approach was employed, involving the program management team and an external evaluation consultancy.
• An utilization-focused evaluation framework was adopted, informed by developmental evaluation principles.
• Knowledge translation principles were embedded throughout the evaluation process to facilitate the translation of findings into practice.

Main Results:

• Combining external information, practice-based knowledge, and local insights proved invaluable for program understanding.
• Integrating evaluative information from the program's inception and throughout its duration yielded significant benefits.
• A collaborative working relationship between the program team and evaluators enhanced the quality of information produced.
• Communicating findings effectively to diverse audiences in tailored formats was crucial for impact.

Conclusions:

• Collaborative, utilization-focused evaluations are effective for non-profit programs, especially in public health.
• Integrating diverse knowledge sources (external, internal, local) enhances evaluation utility and program improvement.
• Embedding knowledge translation principles and maintaining collaborative relationships are key to maximizing evaluation impact and informing practice.