Related Experiment Video
Updated: Aug 6, 2025

The Participant-Reported Implementation Update and Score PRIUS: A Novel Method for Capturing Implementation-Related Data Over Time
Published on: February 19, 2021
Increasing the Impact of Program Evaluation: The Importance of Challenging Assumptions and Incorporating New
1National Bureau of Economic Research (NBER), Cambridge, MA, USA.
Abstract:
These remarks, which were given as the 2022 Recipient of the Peter H. Rossi Award for Contributions to the Theory or Practice of Program Evaluation, emphasize ways to increase the impact of program evaluation. First, is the importance of asking good questions, including ones that challenge the assumptions and models that dominate the field. Relatedly, we need to question the assumption that "one size fits all" and recognize the variation that exists-across contexts, time, and individuals. The key question is what works for whom under what conditions, and this also pushes us to think about why effects differ and what is driving those differences, that is, the underlying mechanisms. It is also important to incorporate new perspectives to improve our questions, models, research design, and interpretation, thus helping to address the aforementioned points. We should both welcome diverse perspectives into the research community and listen carefully to the communities we seek to study and incorporating their insights. Although the examples focus on a career in education research, the implications of the points are relevant for any aspect of social policy.
Related Concept Videos
Community Based Intervention
Foundations of Community Mental Health Programs
Central to the success of community-based interventions is the...
Critical Thinking
Colleges and universities are...
Criticisms of the Evolutionary Perspective
Evolutionary psychology provides one explanation for these findings, suggesting...
Humanistic Psychology
This approach...
Strategies for Assessing and Addressing Confounding
Confounding can be addressed at both the design phase of a study and through analytical methods after data...
Revisionist Views of Adolescent and Adult Cognition

