Related Experiment Videos
Evaluating informatics applications--clinical decision support systems literature review
1Center for Medical Informatics, Yale University School of Medicine, New Haven, CT, USA. bonnie.kaplan@yale.edu
International Journal of Medical Informatics
|October 24, 2001
Summary
Clinical decision support systems (CDSS) show potential to improve care, but evidence for diagnostic aids is mixed. Many systems are underutilized, and evaluation methods often neglect real-world clinical settings and contextual factors.
Area of Science:
- Medical Informatics
- Health Services Research
- Clinical Decision Support
Background:
- Clinical decision support systems (CDSS) are widely believed to hold potential for enhancing healthcare delivery.
- Existing literature suggests a consensus on the potential benefits of CDSS, though evidence for specific applications like diagnostic support remains equivocal.
Purpose of the Study:
- To review the existing literature on clinical decision support systems (CDSS), with a specific focus on their evaluation methodologies.
- To identify gaps and limitations in current CDSS evaluation practices and their implications for understanding system effectiveness.
Main Methods:
- A comprehensive review of clinical decision support systems (CDSS) evaluation literature.
- Analysis of study designs, with a focus on experimental and randomized controlled trials (RCTs) and their limitations in assessing real-world utility.
- Examination of the theoretical underpinnings and contextual factors considered in CDSS evaluation studies.
Main Results:
- While CDSS are generally perceived to improve care, evidence for diagnostic support systems is less conclusive.
- A significant portion of CDSS are underutilized despite their potential benefits.
- Evaluation studies predominantly focus on clinical performance changes using experimental designs, with limited use of naturalistic or field-testing approaches in routine clinical settings.
- There is a lack of theoretical discussion concerning contextual factors influencing CDSS adoption and effectiveness.
Conclusions:
- Current evaluation practices for CDSS often overlook real-world implementation challenges and contextual factors, hindering a comprehensive understanding of their effectiveness.
- The limited use of naturalistic designs and theoretical frameworks in CDSS evaluations leads to less informed decision-making regarding these technologies and broader medical informatics applications.
- Further research incorporating diverse evaluation methodologies and theoretical perspectives is needed to optimize the development and implementation of effective CDSS.