Formative evaluation of a patient-specific clinical knowledge summarization tool.

Area of Science:

• Medical Informatics
• Clinical Decision Support Systems
• Health Information Technology

Background:

• Clinicians face challenges in efficiently accessing and synthesizing vast amounts of medical information.
• Existing search methods like UpToDate and PubMed can be time-consuming.
• There is a need for tools that can rapidly summarize clinical knowledge for direct application.

Purpose of the Study:

• To iteratively design and develop a prototype of a Computerized Clinical Knowledge Summarization (CKS) tool.
• To assess the usability, usefulness, efficiency, and impact of the CKS prototype on physicians' perceived decision quality.
• To compare the CKS prototype's performance against standard search of UpToDate and PubMed.

Main Methods:

• A mixed-methods approach was employed, observing 10 physicians interacting with the CKS prototype.
• Physicians used the CKS tool and standard search methods to answer clinical questions from case vignettes.
• Usability tasks and perceived decision quality were measured.

Main Results:

• The CKS tool effectively summarizes patient-specific, actionable recommendations from PubMed and UpToDate.
• Most usability tasks were completed successfully, with rapid task completion times for many items.
• Physicians reported significantly higher perceived decision quality using the CKS prototype compared to standard search, with no significant difference in search time.

Conclusions:

• The CKS prototype demonstrated good usability and usefulness among physicians.
• Physicians perceived improved decision quality when using the CKS tool, within comparable search times.
• Further research with larger sample sizes is needed to confirm efficiency and efficacy findings.