Mixed-methods evaluation in complex programmes: the National Reading Plan in Portugal.

Area of Science:

• Public Policy Evaluation
• Educational Program Assessment
• Mixed Methods Research

Background:

• The National Reading Plan (NRP) is a Portuguese public policy initiative.
• The NRP aims to improve literacy levels and reading habits across the population.
• The first phase of the NRP spanned five years (2006-2011).

Purpose of the Study:

• To highlight evaluation strategies for complex programs.
• To demonstrate the effectiveness of a pluralist, integrating approach using mixed methods.
• To analyze the development and implementation of the National Reading Plan.

Main Methods:

• Utilized a mixed-methods approach, combining quantitative and qualitative data collection.
• Employed an evaluation model for continuous and systematic monitoring.
• Gathered information from diverse sources and social actors involved in the NRP.

Main Results:

• Mixed methods provided valuable insights into the NRP's impacts.
• The evaluation facilitated a comprehensive analysis of the program's implementation.
• The approach proved effective for assessing a wide-ranging and complex initiative.

Conclusions:

• A pluralist, integrating approach with mixed methods is highly effective for evaluating complex public policies.
• Continuous monitoring and systematic analysis are crucial for program development.
• This evaluation model offers significant potential for future large-scale program assessments.