Implications of overviews of randomized trials

Many randomized trials are of insufficient sample size to detect with adequate power the small to moderate effects that are most likely to occur. As a result, a single such trial can produce a null finding that is, in fact, uninformative, but none the less is misinterpreted as demonstrating no effect. An overview considers all available trials and can increase the statistical power to detect an effect if present. Thus overviews can provide perhaps the most precise estimate of the magnitude of a treatment effect based on existing data. This may have implications for the formulation of public policy but certainly should influence the conduct and planning of randomized trials. Public policy may be influenced in circumstances where further trials are unlikely to be conducted. Overviews can also provide guidance as to whether changes in protocols of ongoing studies are recommended as a result of new evidence. Perhaps most importantly, overviews can provide information about whether additional trials are warranted, and, if so, the sample size that would be required to answer the research question definitively.