Value-Based Framework for Evaluating Pre-Commercial Procurement: Case Study of Value-Based Key Performance Indicators

The demographic shift toward older populations is placing increasing pressure on health care systems, and only 20% of patients with chronic issues in the industrial world's rural areas have guaranteed access to adequate health care services. This stresses the health care systems, emphasizing the need for innovative solutions. The Horizon 2020 Pre-Commercial Procurement (PCP) project, Crane, addresses these needs by facilitating the procurement of a digital self-management system for treating patients with chronic issues at home. Three rural European regions are participating in the project: Västerbotten (Sweden), Extremadura (Spain), and Agder (Norway).

This study aims to explore and identify key design criteria and value-based key performance indicators (VB-KPIs) to support the development and evaluation of digital health care solutions for patients with chronic issues in rural areas within the Crane PCP process.

A 3-iteration process was used to identify and prioritize the VB-KPIs in the Crane project. First, user needs were investigated based on stakeholder analyses in the participating rural regions. The early health technology assessment tool, Step Up, was used in 5 workshops (2 in Agder, 2 in Extremadura, and 1 in Västerbotten). Participants included patients and health care professionals. Second, post workshop, stakeholders were asked to comment on the summarized results, which were accordingly adjusted. Third, following the workshops, VB-KPIs were identified and prioritized, and discussions among representatives from the 3 buyer regions were conducted.

Thirty-five VB-KPIs across 5 domains were identified. User-related (9 VB-KPIs), employee-related (9 key performance indicators), clinical (4 VB-KPIs), organizational (6 VB-KPIs), and economic (8 VB-KPIs) outcomes from the workshops and the subsequent discussions emphasized regional differences in terms of user needs and priorities. While Agder (Norway) and Västerbotten (Sweden) emphasized privacy, digital trust, and physical interaction as important, Extremadura (Spain) prioritized negotiation and shared decision-making. Despite differences, shared values were identified, including empowerment, flexibility, preventative care, and improved quality of life.

The identified and prioritized VB-KPIs are likely to provide a need-based foundation for the development and subsequent evaluation of the digital PCP, Crane, although regional socioeconomic and cultural differences may necessitate local adaptations.