Overcoming Challenges to Evidence-Based Policy Development in a Large, Integrated Delivery System

Area of Science:

• Health Services Research
• Implementation Science
• Health Care Management

Background:

• The Veterans Health Administration (VHA) aims to improve veteran care and efficiency through research.
• A new VHA program supports the learning health system paradigm by evaluating health care initiatives.
• This initiative involves collaboration between VHA operations and researchers.

Purpose of the Study:

• To describe a new VHA program designed to foster the learning health system.
• To outline the rigorous evaluation of health care initiatives within the VHA.
• To report lessons learned in designing and implementing these evaluations.

Main Methods:

• Large-scale, randomized program evaluations are being conducted.
• Collaborative design involving outcomes assessment and implementation science.
• Partnerships between VHA operations and researchers facilitate evaluation.

Main Results:

• Key factors for evaluation design include traditional issues (power, data) and overlooked aspects.
• Overlooked factors include intervention financing stability, randomized roll-out adherence, and staff buy-in.
• Managing multiple veto points across programs is a critical consideration.

Conclusions:

• Successful program implementation and evaluation demand resources, expertise, and planning.
• Dedicated programs are necessary to sustain the learning health system model.
• Continuous adaptation of evaluation designs is crucial for organizational learning.