Use of real-world evidence in meta-analyses and cost-effectiveness models

Real-world evidence (RWE) provides external validity, supplementing and enhancing the randomized controlled trial data with valuable information on patient behaviors and outcomes, turning efficacy and safety results into real-world effectiveness and risks, but the use of RWE is associated with challenges. The objectives of this communication were to (1) summarize all guidance on how to conduct an RWE meta-analysis (MA) and how to develop an RWE cost-effectiveness model, (2) to describe our experience, challenges faced and solutions identified, (3) to provide recommendations on how to conduct such analyses. No formal guidelines on how to conduct an RWE MA or to develop an RWE cost-effectiveness model were identified. Using the context of non-vitamin K antagonist oral anticoagulants in stroke prevention in atrial fibrillation, we conducted an RWE MA, after having identified sources of uncertainty. We then implemented the results in an RWE cost-effectiveness model, defined as a model where all inputs come from RWE, including all parameters related to treatment effect. Based on challenges faced, our first recommendation relates to the necessity of conducting sensitivity analyses, either based on clinical or methodological considerations. Our second recommendation is the need for extensive collaboration with a wide range of experts, during the development of the analyses protocols, the implementation of the analyses and the interpretation of the results. RWE may address a number of gaps related to the treatment effect, and RWE economic evaluations for the treatment effect can provide extremely valuable insights into real-world economic value of interventions. As the increased recognition of the value of RWE could influence health technology assessment decision, and current practices, this communication supports the urgent need of more formal guidelines.