Development of a Multi-Criteria Decision Analysis Rating Tool to Prioritize Real-World Evidence Questions for the

Ambica Parmar1,2, Wei Fang Dai2, Francois Dionne3

  • 1Division of Medical Oncology & Hematology, Department of Medicine, Sunnybrook Health Sciences Centre, Toronto, ON M4N 3M3, Canada.

Insights

The Canadian Real-world Evidence for Value of Cancer Drugs collaboration created a tool to prioritize cancer drug evidence questions. This multi-criteria decision analysis (MCDA) tool helps assess the importance and feasibility of real-world evidence (RWE) studies.

Area of Science:

  • Health Economics
  • Pharmaceutical Policy
  • Real-World Evidence

Background:

  • Public drug funding decisions in Canada require robust evidence.
  • Prioritizing post-market real-world evidence (RWE) questions is crucial for value assessment.
  • Existing methods for prioritizing RWE questions are not standardized.

Purpose of the Study:

  • To develop and validate a multi-criteria decision analysis (MCDA) rating tool.
  • To assess and prioritize potential post-market RWE questions for cancer drugs.
  • To support evidence-based drug funding decisions in Canada.

Main Methods:

  • A three-step development process involving multidisciplinary stakeholders.
  • Selection of criteria for assessing RWE question importance and feasibility.
  • Development of rating scales, weighting, and aggregate score calculation, followed by validation testing.

Main Results:

  • An initial MCDA rating tool with seven criteria was developed.
  • Criteria assess RWE question importance (clinical benefit, uncertainty magnitude, decision-maker relevance).
  • Criteria assess RWE feasibility (comparator identification, case ascertainment, data availability, expertise).

Conclusions:

  • The MCDA tool provides a structured approach to prioritizing RWE questions.
  • The tool can inform drug funding deliberations by focusing on high-priority evidence needs.
  • Future work will involve refinement with the Canadian Agency for Drugs and Technology in Health.

Related Concept Videos

Decision Making: P-value Method01:09

Decision Making: P-value Method

The process of hypothesis testing based on the P-value method includes calculating the P- value using the sample data and interpreting it.
First, a specific claim about the population parameter is proposed. The claim is based on the research question and is stated in a simple form. Further, an opposing statement to the claim  is also stated. These statements can act as null and alternative hypotheses:  a null hypothesis would be a neutral statement while the alternative hypothesis can...
5.6K
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches01:23

Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches

Biopharmaceutical studies constitute a vital field aiming to enhance drug delivery methods and refine therapeutic approaches, drawing upon diverse interdisciplinary knowledge. In research methodologies, the choice between controlled and non-controlled studies significantly influences the study's reliability and accuracy.
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
151
Hazard Ratio01:12

Hazard Ratio

The hazard ratio (HR) is a widely used measure in clinical trials to compare the risk of events, such as death or disease recurrence, between two groups over time. It reflects the ratio of hazard rates—the instantaneous risk of the event occurring—between a treatment group and a control group. This measure provides valuable insights into the relative effectiveness of a treatment by assessing how the risk of an event differs between the two groups.
For example, in a clinical trial...
172
Decision Making: Traditional Method01:14

Decision Making: Traditional Method

The process of hypothesis testing based on the traditional method includes calculating the critical value, testing the value of the test statistic using the sample data, and interpreting these values.
First, a specific claim about the population parameter is decided based on the research question and is stated in a simple form. Further, an opposing statement to this claim is also stated. These statements can act as null and alternative hypotheses, out of which a null hypothesis would be a...
4.1K
Sensitivity, Specificity, and Predicted Value01:13

Sensitivity, Specificity, and Predicted Value

In healthcare diagnostics, laboratory tests play a crucial role in identifying and diagnosing a wide range of medical conditions. However, interpreting test results is not always straightforward. An abnormal test result does not always confirm the presence of a disease, just as a normal result does not guarantee its absence. To assess the reliability of these diagnostic tools, healthcare practitioners rely on two key statistical indicators: sensitivity and specificity.
Sensitivity is the...
527
Response Surface Methodology01:16

Response Surface Methodology

Response Surface Methodology (RSM) is a collection of statistical and mathematical techniques used to develop, improve, and optimize processes. It is particularly valuable when many input variables or factors potentially influence a response variable.
The process of RSM involves several key steps:
195