Towards a More Simplified Approach for Evaluating Strength of Evidence in Health Technology Assessments

It is imperative to thoroughly evaluate the safety, effectiveness, and cost-utility of a new medical device prior to the widespread adoption of the technology. Health technology assessment (HTA) is a systematic evaluation of the benefits and harms of a health technology that aims to inform healthcare policy decisions, improve utilization of cost-effective new technologies, and prevent the adoption of devices with harmful or doubtful value for the health system. Even though dozens of organizations perform HTAs, there is no universally accepted criterion for conducting, reporting, and deriving conclusions from an HTA. Thus, there are considerable discrepancies in the methodologies among HTAs such that the same device with the same underlying clinical evidence is often endorsed by one agency but not another, leading to inconsistencies in healthcare coverage policy decisions. Here, we propose a more simplified and unified approach for summarizing clinical effectiveness and safety outcomes for HTAs. We developed a short, semi-quantitative scoring tool that can be used to provide an overall evaluation of evidence strength in HTAs consisting of five categories: (a) the number of randomized controlled trials (RCTs) that have been performed using the technology, (b) the risk of bias among RCTs, (c) the effect size observed for the key effectiveness outcome, (d) the effect size observed for the key safety outcome, and (e) the generalizability of outcomes observed in RCTs to those observed in real-world clinical use. Utilization of this simplified semi-quantitative framework may simplify the HTA process and improve the consistency of the resulting recommendations.