Related Experiment Video
Updated: Apr 11, 2026
Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
An introduction to methodological issues when including non-randomised studies in systematic reviews on the effects
Barnaby C Reeves1, Julian P T Higgins2,3, Craig Ramsay4
1Clinical Trials and Evaluation Unit, School of Clinical Sciences, University of Bristol, UK.
Background:
Methods need to be further developed to include non-randomised studies (NRS) in systematic reviews of the effects of health care interventions. NRS are often required to answer questions about harms and interventions for which evidence from randomised controlled trials (RCTs) is not available. Methods used to review randomised controlled trials may be inappropriate or insufficient for NRS.
Aim And Methods:
A workshop was convened to discuss relevant methodological issues. Participants were invited from important stakeholder constituencies, including methods and review groups of the Cochrane and Campbell Collaborations, the Cochrane Editorial Unit and organisations that commission reviews and make health policy decisions. The aim was to discuss methods for reviewing evidence when including NRS and to formulate methodological guidance for review authors.
Workshop Format:
The workshop was structured around four sessions on topics considered in advance to be most critical: (i) study designs and bias; (ii) confounding and meta-analysis; (iii) selective reporting; and (iv) applicability. These sessions were scheduled between introductory and concluding sessions.
Summary:
This is the first of six papers and provides an overview. Subsequent papers describe the discussions and conclusions from the four main sessions (papers 2 to 5) and summarise the proposed guidance into lists of issues for review authors to consider (paper 6). Copyright © 2013 John Wiley & Sons, Ltd.
Related Concept Videos
01:23Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
01:15Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...
01:22Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
01:20Bioequivalence Experimental Study Designs: Completely Randomized and Randomized Block Designs
01:20Study Designs in Epidemiology
Observational studies are those where the researcher does not intervene but rather observes natural variations. They include cross-sectional, cohort, and...
01:29Bias in Epidemiological Studies