Related Experiment Video
Updated: Jun 16, 2026

The Adjuvant Efficacy of Angong Niuhuang Pill in the Treatment of Viral Encephalitis: A Meta-Analysis of Randomized Controlled Trials
Published on: April 19, 2024
Inconsistent trial assessments by the National Institute for Health and Clinical Excellence and IQWiG: standards for
J Hasford1, P Bramlage, G Koch
1Institut für Medizinische Informationsverarbeitung, Biometrie und Epidemiologie, LMU München, Marchioninistrasse 15, Munich, Germany. has@ibe.med.uni-muenchen.de
Insights
Discrepancies in evaluating medical interventions exist, even when standards are similar. Different interpretations of subgroup analyses, like in the CAPRIE trial, highlight the need for unified international guidelines on heterogeneity assessment.
Area of Science:
- Health Services Research
- Clinical Trial Methodology
- Regulatory Science
Background:
- Established methodologies exist for critically assessing medical interventions.
- Regulatory agencies generally adhere to consistent standards for intervention assessment.
- Practical application of these standards can lead to inconsistencies.
Purpose of the Study:
- To examine discrepancies in the interpretation of subgroup analyses in medical interventions.
- To illustrate a lack of consensus in evaluating treatment comparisons across patient subgroups.
- To highlight the need for standardized international guidelines.
Main Methods:
- Comparative analysis of the evaluation of the CAPRIE trial by two regulatory bodies: NICE (UK) and IQWiG (Germany).
- Focus on the interpretation of heterogeneity in treatment effects across subgroups.
- Examination of the Clopidogrel versus Aspirin in Patients at risk of Ischemic Events (CAPRIE) trial data.
Main Results:
- NICE concluded CAPRIE showed overall clinical benefit in the intention-to-treat (ITT) population, robust to heterogeneity.
- IQWiG interpreted heterogeneity as limiting clinical benefit to specific subgroups with statistically significant results, disregarding the ITT analysis.
- Divergent conclusions arose from differing interpretations of subgroup analysis and heterogeneity.
Conclusions:
- International standards are required for conducting and interpreting subgroup analyses in clinical trials.
- Standardized approaches are needed for assessing heterogeneity between strata.
- Harmonized guidelines would improve consistency in the critical appraisal of medical interventions.
Objectives:
The methodology for the critical assessment of medical interventions is well established. Regulatory agencies and institutions adhere, in principle, to the same standards. This consistency, however, is not always the case in practice.
Study Design And Setting:
Using the evaluation of the CAPRIE (Clopidogrel versus Aspirin in Patients at risk of Ischemic Events) trial by the British National Institute for Health and Clinical Excellence (NICE) and the German Institute for Quality and Efficiency in Health Care (IQWiG), we illustrate that there was no consensus for the interpretation of possible heterogeneity in treatment comparisons across subgroups.
Results:
The NICE concluded that CAPRIE demonstrated clinical benefit for the overall intention-to-treat (ITT) population with sufficient robustness to possible sources of heterogeneity. The IQWiG interpreted the alleged heterogeneity as implying that the clinical benefit only applied to the subgroup of patients with a statistically significant result irrespective of the results of the ITT analysis.
Conclusion:
International standards for the performance and interpretation of subgroup analyses as well as for the assessment of heterogeneity between strata are needed.
Related Concept Videos
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Cochran's Q Test
Bias in Epidemiological Studies
Bioequivalence Data: Statistical Interpretation
Bioequivalence studies: Biowaivers
Confounding in Epidemiological Studies