Criteria for evaluating alternative MEDLINE search engines

With so many options available for searching MEDLINE on the World Wide Web or as a component of an online service, evaluation criteria are suggested as a means of assisting librarians in determining the positive and negative aspects of alternative MEDLINE sites. A set of searches was utilized to systematically compare MEDLINE sites. Sites evaluated included Avicenna, America Online, HealthGate, PubMed, Medscape, and Physicians' Online. Some features used to evaluate these sites were: default fields; operators (default); access to MeSH; subheadings; stop words protected in MeSH; truncation; and stemming. This article will describe the group process used to arrive at the evaluation criteria, as well as some general conclusions which will help librarians in directing their users to a particular MEDLINE site.