Diabetes management intervention studies: lessons learned from two studies

Several clinical studies investigated improvements of patient outcomes due to diabetes management interventions. However, chronic disease management is intricate with complex multifactorial behavior patterns. Such studies thus have to be well designed in order to allocate all observed effects to the defined intervention and to exclude effects of other confounders as well as possible. This article aims to provide challenges in interpreting diabetes management intervention studies and suggests approaches for optimizing study implementation and for avoiding pitfalls based on current experiences.

Lessons from the STeP and ProValue studies demonstrated the difficulty in medical device studies that rely on behavioral changes in intervention group patients. To successfully engage patients, priority should be given to health care professionals being engaged, operational support in technical issues being available, and adherence being assessed in detail. Another difficulty is to avoid contamination of the control group with the intervention; therefore, strict allocation concealment should be maintained. However, randomization and blinding are not always possible. A limited effect size due to improvements regarding clinical endpoints in the control group is often caused by the Hawthorne effect. Improvements in the control group can also be caused with increased attention paid to the subjects. In order to reduce improvements in the control group, it is essential to identify the specific reasons and adjust study procedures accordingly. A pilot phase is indispensable for this. Another option is to include a third study arm to control for enhanced standard of care and study effects. Furthermore, retrospective data collection could be a feasible option. Adaptive study designs might reduce the necessity of a separate pilot study and combine the exploratory and confirmatory stages of an investigation in one single study.

There are several aspects to consider in medical device studies when using interventions that rely on changes in behavior to achieve an effective implementation and significant study results. Improvements in the control group may reduce effect sizes and limit statistical significance; therefore, alternatives to the traditional randomized controlled trials may be considered.