An evidence-based method for assessing the value of a search tool: a pilot study
Related Experiment Video
Updated: Feb 4, 2026

Pattern-based Search of Epigenomic Data Using GeNemo
Published on: October 8, 2017
Donald Stanley Pearson1, Stevo Roksandic2, Jill Kilanowski3
1Manager, Patient and Family Resource Center, James Cancer Hospital and Solove Research Institute, The Ohio State University Comprehensive Cancer Center, Room C001, Ground Floor Lobby, 460 West 10th Avenue, Columbus, OH 43210.
Objective:
The objective of this study was to develop an evidence-based method with a set of metrics that could be used to assess an information search tool.
Methods:
This pilot study analyzed a two-group convenience sample of graduate nursing students and resident physicians. The intervention group received ten minutes of instruction on a familiar search tool (eSearcher). Each group was provided one prompt to search for clinical guidelines on a given topic within their scope of practice and asked to find the best result using only eSearcher (intervention group) or specifically excluding eSearcher (comparison group). Three measurements of search results were employed: time elapsed to complete the search, an accuracy score, and a participant-reported score of confidence in the result.
Results:
Forty-two students participated in this study (23 graduate nursing students and 19 resident physicians). The intervention group consisted of 22 participants (12 graduate nursing students and 10 resident physicians), and the comparison group consisted of 20 participants (11 graduate nursing students and 9 resident physicians). The intervention group had lower mean ranks in both accuracy and confidence compared to the comparison (not eSearcher) group, although these differences were not significant. However, the intervention (eSearcher) group had significantly longer search times compared to the comparison (not eSearcher) group.
Discussion:
These findings provided new insights into the performance of the search tool and how users felt about their search experience. The quantitative evidence gained from this study led directly to an informed decision to explore other options for search tools. The evidence-based methods and process developed in this pilot study will enable similar studies to test other student groups and other search tools, leading to better informed purchasing and instructional decisions.
More Related Videos
03:10Pilot In Vitro Study to Assess Cleaning Ability and Effects of Different Decontamination Methods on Implant Surfaces
Published on: November 21, 2025
08:37The Application of Open Searching-based Approaches for the Identification of Acinetobacter baumannii O-linked Glycopeptides
Published on: November 2, 2021
Related Concept Videos
The Evidence for Evolution
Pilot and Numeric Relaying
Methods for Studying Drug Absorption: In vitro
The diffusion cell method uses a two-compartment cell, including a donor compartment with the drug solution, which simulates the environment where the drug is applied, and a receptor compartment with a buffer solution, which simulates the environment...
Methods for Studying Drug Absorption: In situ
The Doluisio method involves perfusing a prepared segment of a rat's small intestine with a solution of radiolabeled drug and a non-absorbable marker. This helps to differentiate between absorbed and non-absorbed drug concentrations. The intestinal segment is connected at both ends using tubing and syringes,...
Assessment of blood pressure in brachial artery(one-step method)
Prepare for the Procedure:
Assessment of blood pressure in brachial artery(two-step method)