Evaluating change in health care practice: lessons from three studies

Area of Science:

• Health Services Research
• Nursing Practice Evaluation
• Healthcare Policy

Background:

• Evidence-based practice implementation and evaluation are key policy priorities in the UK National Health Service.
• Healthcare practice evaluation has shifted from profession-led to politically and managerially led approaches over 30 years.
• Pre-set objectives by funders influence current evaluation modes.

Purpose of the Study:

• To illustrate challenges in evaluating changes in healthcare practice developments.
• To propose improved evaluation methodologies for healthcare settings.
• To address the limitations of traditional evaluation approaches in nursing.

Main Methods:

• Analysis of three recent nursing practice evaluations.
• Examination of challenges encountered in evaluating practice changes.
• Exploration of methodological limitations in traditional outcome evaluations.

Main Results:

• Traditional one-off outcome evaluations are insufficient for practice improvement.
• Evaluations need to incorporate cumulative components, context, and process alongside outcomes.
• Challenges in evaluating nursing practice developments were identified.

Conclusions:

• A shift towards cumulative and context-aware evaluations is necessary for meaningful practice improvement.
• Realistic evaluation is proposed as a method to overcome limitations and develop generalizable theory.
• Integrating process and context is crucial for effective healthcare practice evaluation.