Performance Evaluation of Clinical Decision Support Systems (CDSS): Developing a Business Intelligence (BI) Dashboard

Area of Science:

• Health Informatics
• Clinical Decision Support
• Business Intelligence

Background:

• Clinical Decision Support Systems (CDSS) in Electronic Health Records (EHR) aim to reduce medical errors.
• The effectiveness and acceptance of CDSS are often questioned, highlighting the need for performance monitoring.
• Successful software development, including BI dashboards, relies on thorough requirements analysis.

Purpose of the Study:

• To develop a Business Intelligence (BI) dashboard for monitoring drug-drug interaction (DDI) alerts within EHR systems.
• To analyze requirements using a scoring methodology for indicators and visualization methods.
• To operationalize EHR content repositories for better understanding and optimization of CDSS.

Main Methods:

• Development of a BI dashboard tailored for tracking CDSS alerts.
• Requirements analysis incorporating a scoring methodology for indicator relevance and visualization techniques.
• Utilizing BI as a tool to monitor CDSS behavior and performance within EHR.

Main Results:

• A functional BI dashboard was designed to meet specific monitoring indicators.
• The BI dashboard facilitated the operationalization of the EHR content repository.
• Enhanced understanding of CDSS override patterns was achieved, paving the way for system optimization.

Conclusions:

• BI dashboards are effective tools for monitoring CDSS performance in EHR.
• The developed dashboard provides insights into DDI alert overrides, enabling system optimization.
• This approach maximizes the understanding of EHR content and supports future improvements in CDSS functionality.