Medical students using Grateful Med: analysis of failed searches and a six-month follow-up study

Medical students at the University of Missouri were taught to search MEDLINE using the Grateful Med software. The traffic files of student searches were analyzed for search behavior. This paper reports on two specific aspects of these analyses: (1) failed searches where retrieval was either too large or too small (zero hits); and (2) a six month follow-up study which focused on error rates and retention of skills. The two major reasons for retrieving too many citations were entering a phrase on a single subject line and a search of only one concept. Of the zero hit searches, the most commonly occurring errors were MeSH (medical subject headings) not used, other MeSH errors, misspelling or keyboard errors, and faulty logic. During the six month follow-up study, the error rates of students declined in spite of the fact that they had not used the software in six months. Furthermore, a larger percentage of the searches showed a more sophisticated use of MeSH than previously employed.