Related Experiment Video
Updated: Sep 1, 2025
10:07
Using Learning Outcome Measures to assess Doctoral Nursing Education
Published on: June 21, 2010
19.1K
Evaluation Utility Metrics (EUMs) in Reflective Practice
Ralph Renger1, Jessica Renger2, Richard N Van Eck3
1Just Evaluation Services, LLC.
The Canadian Journal of Program Evaluation = La Revue Canadienne D'Evaluation De Programme
|August 18, 2022
Summary
This study introduces three Evaluation Utility Metrics (EUMs) to measure evaluation usefulness beyond technical quality. Practical application demonstrated high consideration and adoption rates for recommendations, improving evaluation practice.
Area of Science:
- Evaluation Science
- Applied Research Methods
Background:
- Reflective practice in evaluation emphasizes accountability beyond technical quality.
- Current evaluation quality assessments often overlook the practical utility of recommendations.
Purpose of the Study:
- To propose and evaluate three metrics for assessing evaluation utility.
- To encourage evaluators to assess the impact and influence of their recommendations.
Main Methods:
- Development of three Evaluation Utility Metrics (EUMs): consideration (EUMc), adoption (EUMa), and level of influence (EUMli).
- Reflection on practical application, including managing expectations and considering contextual factors.
- Analysis of real-world evaluation data to demonstrate EUMs' value.
Main Results:
- Implementation of practice tips resulted in 100% consideration (EUMc) and over 80% adoption (EUMa) of recommendations.
- The study highlights the importance of negotiation for data collection and the influence of external factors on recommendation adoption.
- EUMs provide evidence of evaluation utility and potential for practice improvement.
Conclusions:
- Evaluation Utility Metrics (EUMs) offer a valuable framework for assessing evaluation impact.
- Focusing on recommendation timing and frequency can increase EUM rates.
- Integrating EUMs supports evaluators in improving practice and demonstrating utility.
Related Concept Videos
02:57The Sense of Self: Reflected Self-Appraisal and Social Comparison
50.8K
According to Charles Cooley, we base our image on what we think other people see (Cooley 1902). We imagine how we must appear to others, then react to this speculation. We don certain clothes, prepare our hair in a particular manner, wear makeup, use cologne, and the like—all with the notion that our presentation of ourselves is going to affect how others perceive us. We expect a certain reaction, and, if lucky, we get the one we desire and feel good about it. But more than that, Cooley...
50.8K
01:25Critical Thinking II
2.9K
Critical thinking is a cognitive process with several attributes. The attributes of critical thinking include the following:
2.9K
03:00Self-Evaluation: Self-Enhancement and Self-Verification
5.3K
Social psychologists have documented that feeling good about ourselves and maintaining positive self-esteem is a powerful motivator of human behavior (Tavris & Aronson, 2008). In the United States, members of the predominant culture typically think very highly of themselves and view themselves as good people who are above average on many desirable traits (Ehrlinger, Gilovich, & Ross, 2005). Often, our behavior, attitudes, and beliefs are affected when we experience a threat to our...
5.3K
01:26Metacognition
265
Metacognition is a conscious process where individuals are aware of their cognitive and executive processes, such as planning before solving a problem or self-monitoring during reading. For instance, a writer may need help with composing a piece. The situation involves a writer who is working on a piece of writing, but while doing so, they realize that something is missing. They notice that their characters lack depth or details. This realization occurs because the writer is reflecting on their...
265
01:15Nursing Evaluation
3.5K
The evaluation stage signals the end of the nursing process. The nurse gathers evaluative data to assess whether or not the patient has attained the expected results. Whereas the nurse collects data in the nursing assessment to identify the patient's health concerns, the evaluation stage data determines if the indicated health issues are resolved. Evaluative data collection includes two sections: the data acquired to evaluate patient outcomes and the time criteria for data collection.
3.5K
01:13Patient-centered Care
2.2K
Patient-centered care involves delivering care beyond inpatient hospitalization. Reflective practice can enhance a patient-centered approach. Reflective practice is a process of reasoning that considers all aspects of the present situation, including practicalities, learning from personal practice, and consideration of patient needs. Patients appreciate care decisions made while considering their input. Involving the patient in their care provides the patient with a sense of contribution rather...
2.2K