Diagnostic Performance, Triage Safety, and Usability of a Clinical Decision Support System Within a University...

Area of Science:

• Health Informatics
• Clinical Decision Support Systems
• Emergency Medicine

Background:

• Computerized Clinical Decision Support Systems (CDSSs) are increasingly used in healthcare.
• CDSSs often lack rigorous scientific validation compared to standard medical care.
• This study addresses the need for evidence-based validation of CDSS performance in clinical settings.

Purpose of the Study:

• To evaluate the performance, safety, and usability of a CDSS.
• The study was conducted in a university hospital emergency department in Kuopio, Finland.
• The aim was to compare CDSS evaluations with physician assessments.

Main Methods:

• 248 adult patients participated voluntarily in the emergency department.
• Patients completed a web-based CDSS form prior to triage nurse evaluation.
• Urgency was assessed by two physicians retrospectively; usability was measured using the System Usability Scale.

Main Results:

• The CDSS showed 85% sensitivity for urgent cases, matching physician performance.
• The CDSS did not miss any physician-identified emergency cases.
• Differential diagnosis accuracy was 45.5%, and usability was rated as good (mean SUS score of 78.2).

Conclusions:

• The CDSS is a sensitive tool for urgent cases in emergency departments, comparable to physicians.
• The system demonstrated acceptable diagnostic accuracy and good usability.
• Findings support further real-world assessment of CDSS for accelerating triage and patient categorization.