Experiential curriculum improves medical students' ability to answer clinical questions using the internet

Teaching about evidence-based medicine (EBM) is widespread, yet physicians still use rapid references preferentially over EBM techniques such as literature searching and appraisal of original research. The Internet now provides rapid access to preappraised evidence. We provided clinically integrated teaching of using the Internet to answer clinical questions for third-year medical students and assessed the change in their search skills.

The curriculum included two 90-minute computer lab sessions with teaching of search skills related to clinical questions. Immediately before the first and after the second session, students recorded sites searched, time needed for searching, and answers found for three standardized questions. Pretest and posttest questions were matched and reversed with each block.

Eighty-six students completed pretests and posttests. For two questions about conventional medical care, posttest answer quality was significantly higher, and posttest search times were significantly shorter, by 1.6 minutes for question 1 (mean pretest search time 6.3 minutes, mean posttest search time 4.7 minutes) and 1.9 minutes for question 2 (mean pretest search time 8 minutes, mean posttest search time 6.1 minutes). For a question about herbal medicine, results were similar, but there were smaller differences that did not reach statistical significance. Students used or found significantly fewer sites on the posttest than on the pretest to find answers for all three question types (absolute difference=0.3 sites for each question). CONCLUSIONS Introducing students to useful Web sites, practicing answering clinical questions, and integrating this process with clinical rotation experiences can reduce the effort that students need to find answers and improve the quality of answers they find.