Related Experiment Video
Updated: Mar 15, 2026

Author Spotlight: Evaluating the Adjuvant Efficacy and Safety of Angong Niuhuang Pill in Viral Encephalitis Treatment
Published on: April 19, 2024
There were large discrepancies in risk of bias tool judgments when a randomized controlled trial appeared in more
Vanessa M B Jordan1, Sarah F Lensen1, Cynthia M Farquhar1
1Department Obstetrics and Gynaecology, Auckland University, Private Bag 92019, Auckland 1142, New Zealand.
Objectives:
To assess the consistency in risk of bias (RoB) judgments across Cochrane reviews for studies appearing in more than one Cochrane review in the field of subfertility.
Study Design And Setting:
We retrieved any study that had been used more than once in systematic reviews present on the Cochrane Database of Systematic Reviews in the area of subfertility. We then retrieved the recorded RoB assessments for these studies and looked at the consistency of judgments made between different authoring teams on the same trials.
Results:
From the 156 bias judgments that were completed by at least two separate groups of authors, 45% of these judgments differed. For the domains of random sequence generation and incomplete outcome data, there was reasonably high level of agreement (71% and 79%, respectively). However, for the domain of blinding, agreement was reached in only 35% of cases.
Conclusion:
This assessment of how consistently the RoB is being applied in Cochrane reviews has shown that, especially in some domains, there are large discrepancies in how RoB is being evaluated. Further work needs to be undertaken to improve the application of this tool.
Related Concept Videos
Bias in Epidemiological Studies
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast,...
Bias
In statistics, a sampling bias is created when a sample is collected from a population, and some members of the population are not as likely to be chosen as others (remember, each member...
Hazard Ratio
For example, in a clinical trial...
Randomized Experiments
Simple randomization
Simple...
Blinding

