Development and pilot test of a new set of good practice indicators for chronic cancer pain management

Pain is among the most important symptoms in terms of prevalence and cause of distress for cancer patients and their families. However, there is a lack of clearly defined measures of quality pain management to identify problems and monitor changes in improvement initiatives.

We built a comprehensive set of evidence-based indicators following a four-step model: (1) review and systematization of existing guidelines to list evidence-based recommendations; (2) review and systematization of existing indicators matching the recommendations; (3) development of new indicators to complete a set of measures for the identified recommendations; and (4) pilot test (in hospital and primary care settings) for feasibility, reliability (kappa), and usefulness for the identification of quality problems using the lot quality acceptance sampling (LQAS) method and estimates of compliance.

Twenty-two indicators were eventually pilot tested. Seventeen were feasible in hospitals and 12 in all settings. Feasibility barriers included difficulties in identifying target patients, deficient clinical records and low prevalence of cases for some indicators. Reliability was mostly very good or excellent (k > 0.8). Four indicators, all of them related to medication and prevention of side effects, had acceptable compliance at 75%/40% LQAS level. Other important medication-related indicators (i.e., adjustment to pain intensity, prescription for breakthrough pain) and indicators concerning patient-centred care (i.e., attention to psychological distress and educational needs) had very low compliance, highlighting specific quality gaps.

A set of good practice indicators has been built and pilot tested as a feasible, reliable and useful quality monitoring tool, and underscoring particular and important areas for improvement.