Evaluability assessment of a community development leisure program in Spain

Area of Science:

• Program Evaluation
• Organizational Learning
• Public Policy Assessment

Background:

• Evaluability assessments (EAs) are crucial for minimizing uncertainty and resource expenditure in subsequent program evaluations.
• Existing EA models may lack flexibility and adaptability across diverse programs and contexts.
• There is a need for a transferable and pedagogically sound EA framework.

Purpose of the Study:

• To present the results of an evaluability assessment (EA) conducted in Spain.
• To introduce a novel EA model designed with a holistic and flexible methodology.
• To demonstrate the utility of the EA model in fostering organizational learning and preparing for impact evaluation.

Main Methods:

• A qualitative methodology was employed for the EA.
• Methods included documentary analysis, semi-structured interviews with stakeholders, direct observation sessions, and expert checklists.
• A new EA model was developed by integrating three theoretical approaches.

Main Results:

• The EA process promoted organizational learning and provided a clear theoretical model for the program.
• The assessment successfully identified program strengths and barriers to efficient evaluation.
• The outcome report facilitated a more logical and assessable framework for future evaluations.

Conclusions:

• The developed EA model is adaptable, transferable, and effective in enhancing program understanding.
• The EA successfully prepared the program for a subsequent results-based evaluation.
• Recommendations for a rigorous results evaluation, including pretest-posttest measurements and a control group, were made.