Evaluative criteria in practice: Findings from an analysis of evaluations published in Evaluation and Program...

Evaluative criteria represent values about characteristics that define a successful evaluand. Criteria direct evaluators' lines of inquiry, including how aims are framed, which questions are asked, and what conclusions are reached. Yet, criteria often remain unstated, and little is known about criteria employed in practice.

We analyzed 141 evaluations published in Evaluation and Program Planning over four years (2016-2019). Applying a model of criteria domains, we utilized collaborative, interpretive coding to surface and examine the criteria embedded in evaluation aims, questions, and conclusions. We also identified methods used to gather evaluation data.

Analysis illuminated eight criteria domains evident in the sample and revealed how multiple domains were combined within individual evaluations. We found overlap among data collection methods used to investigate different domains.

Findings reveal the variety of criteria employed in practice and how evaluators combine criteria to examine multifaceted evaluands. Findings also highlight the need for evaluators to understand how to adapt methods to investigate different criteria domains. This article contributes to the empirical knowledge base about evaluative criteria and identifies revisions to the criteria model.