Clinical Decision Making Medical Search Systems Experimental Study | JoVE Visualize

Area of Science:

Clinical decision-making in medical practice
Health information retrieval systems
Cognitive load in healthcare settings

Background:

Clinicians frequently encounter clinical questions during patient care that they cannot resolve with existing knowledge. While medical literature search systems like PubMed are available, clinicians often lack time to use them effectively. Prior research has shown that these systems can improve accuracy when used without constraints. However, no prior work had resolved how time pressure impacts the effectiveness of such systems in real-world clinical settings. This gap motivated the current study to explore how time pressure influences the use of search systems in answering clinical questions. The study aimed to determine whether time constraints reduce the benefits of using search systems. It also sought to assess how time pressure affects user confidence, task difficulty, and stress levels. The study's design allowed for a direct comparison between knowledge-based and search-assisted decision-making under varying time conditions. This approach provided insights into the limitations of current systems in high-pressure clinical environments.

Purpose Of The Study:

The study aimed to evaluate how time pressure affects the use of medical literature search systems in clinical decision making. It focused on whether time constraints reduce the accuracy of answers obtained through such systems. The specific problem addressed was the gap in understanding how time pressure influences the effectiveness of search systems in real-world clinical settings. The motivation stemmed from the observation that clinicians often work under time constraints and may not use search systems optimally. The study sought to quantify the impact of time pressure on answer accuracy, user confidence, and perceived task difficulty. It also aimed to assess stress levels associated with time-limited search tasks. The study's design allowed for a comparison of performance under low and high time pressure. This approach enabled a clearer understanding of how time constraints affect clinical decision-making processes.

Main Methods:

The study involved two stages with 109 participants, including medical students and practicing clinicians. In the first stage, participants answered 16 clinical questions using only their own knowledge. In the second stage, they used a search system similar to PubMed to answer the same questions. Time pressure was simulated by limiting search time to 3, 6, or 9 minutes per question. The study measured correct answer rates, confidence levels, task difficulty perceptions, and stress levels. Data were collected through structured questionnaires and system logs. The study design allowed for within-participant comparisons across time conditions. This approach ensured that individual differences did not confound the results. The use of a controlled experimental setup enabled precise measurement of the effects of time pressure.

Main Results:

Under low time pressure, the correct answer rate improved by 32% when participants used the search system. However, under high time pressure, the improvement was only 6%. Participants reported significantly lower confidence in answers when time was limited. They also perceived higher task difficulty and experienced higher stress levels under high time pressure. These findings suggest that time constraints reduce the effectiveness of search systems in clinical settings. The study showed a clear decline in performance metrics as time pressure increased. The results highlight the limitations of current search systems in high-pressure environments. The data provide evidence that time pressure significantly impacts both accuracy and user experience.

Conclusions:

The study found that time pressure reduces the effectiveness of medical literature search systems in supporting accurate clinical decisions. Under high time pressure, the improvement in correct answer rates was minimal compared to low time pressure. Participants also reported lower confidence, higher task difficulty, and increased stress levels. These findings suggest that traditional document search systems may not be optimal in time-constrained environments. The authors propose that faster information retrieval and analysis systems could be more effective alternatives. They suggest that system designs should prioritize speed and ease of use to better support clinicians under time pressure. The study highlights the need for search systems that can deliver relevant information quickly. These findings have implications for both clinical practice and system development.