A lesson in implementation: A pre-post study of providers' experience with artificial intelligence-based clinical...

Area of Science:

• Healthcare Informatics
• Artificial Intelligence in Medicine
• Clinical Decision Support Systems

Background:

• Staff attitudes towards AI-based clinical decision support (CDS) are crucial for technology adoption.
• Understanding user experience with AI tools is essential for optimizing healthcare delivery.

Purpose of the Study:

• To explore healthcare staff attitudes towards AI-based CDS tools.
• To assess the impact of AI-based CDS on care coordination and user recommendations.

Main Methods:

• Anonymous surveys were administered to clinical staff before and after AI-based CDS implementation.
• The AI-based CDS aimed to improve glycemic control in diabetic patients.
• Surveys assessed staff perceptions of care coordination and willingness to recommend the tool.

Main Results:

• Care coordination significantly improved post-implementation (p < 0.01).
• Only 14% of users would recommend the AI-based CDS.
• The most favored aspect was promoting team dialogue; the least favored was inadequate intervention recommendations.

Conclusions:

• Negative perceptions of AI-based CDS interventions can temper staff enthusiasm for AI technology.
• Hands-on experience with AI can lead to more realistic expectations of its capabilities.
• AI developers must differentiate tasks best suited for AI versus human clinical teams.