Related Experiment Video
Updated: Jun 10, 2026

Meta-Analysis of the Effectiveness and Safety of Shugan Jieyu Capsules for the Treatment of Insomnia
Published on: February 17, 2023
Searching for answers to clinical questions using google versus evidence-based summary resources: a randomized
Sarang Kim1, Helaine Noveck, James Galt
1Dr. Kim is clinical associate professor, Department of Medicine, Rutgers University Robert Wood Johnson Medical School, New Brunswick, New Jersey. Ms. Noveck is research teaching specialist, Department of Medicine, Rutgers University Robert Wood Johnson Medical School, New Brunswick, New Jersey. Mr. Galt is curriculum development/instructional design specialist, Robert Wood Johnson Library of the Health Sciences, Rutgers University, New Brunswick, New Jersey. Dr. Hogshire is clinical instructor, Department of Medicine, Rutgers University Robert Wood Johnson Medical School, New Brunswick, New Jersey. Dr. Willett is associate professor, Department of Medicine, Rutgers University Robert Wood Johnson Medical School, New Brunswick, New Jersey. Ms. O'Rourke is library director, Robert Wood Johnson Library of the Health Sciences, Rutgers University, New Brunswick, New Jersey.
Purpose:
To compare the speed and accuracy of answering clinical questions using Google versus summary resources.
Method:
In 2011 and 2012, 48 internal medicine interns from two classes at Rutgers University Robert Wood Johnson Medical School, who had been trained to use three evidence-based summary resources, performed four-minute computer searches to answer 10 clinical questions. Half were randomized to initiate searches for answers to questions 1 to 5 using Google; the other half initiated searches using a summary resource. They then crossed over and used the other resource for questions 6 to 10. They documented the time spent searching and the resource where the answer was found. Time to correct response and percentage of correct responses were compared between groups using t test and general estimating equations.
Results:
Of 480 questions administered, interns found answers for 393 (82%). Interns initiating searches in Google used a wider variety of resources than those starting with summary resources. No significant difference was found in mean time to correct response (138.5 seconds for Google versus 136.1 seconds for summary resource; P = .72). Mean correct response rate was 58.4% for Google versus 61.5% for summary resource (mean difference -3.1%; 95% CI -10.3% to 4.2%; P = .40).
Conclusions:
The authors found no significant differences in speed or accuracy between searches initiated using Google versus summary resources. Although summary resources are considered to provide the highest quality of evidence, improvements to allow for better speed and accuracy are needed.
Related Concept Videos
Blind Procedures
Clinical Trials
There are four phases in a clinical trial. A phase one...
Crossover Experiments
Crossover designs are performed even with smaller sample sizes since the samples can act as their controls. These are better than simple randomized trials since patients are exposed to all the treatments.
Clinical Trials: Overview
Types of Biopharmaceutical Studies: Controlled and Non-Controlled Approaches
Non-controlled studies, commonly employed for initial exploration, lack a control group, rendering them susceptible to biases and external influences. In contrast, controlled...
Bioequivalence Experimental Study Designs: Completely Randomized and Randomized Block Designs
