Establishing trust in artificial intelligence-driven autonomous healthcare systems: an expert-guided framework

Area of Science:

• Computer Science
• Artificial Intelligence
• Healthcare Technology

Background:

• Autonomous Systems (AS) increasingly utilize Artificial Intelligence (AI).
• Ensuring the safety and trustworthiness of AI-powered AS is a growing societal and technical challenge.
• Objective evaluation methods for AI-driven AS trustworthiness are needed, particularly in critical sectors like healthcare.

Purpose of the Study:

• To explore expert perspectives on the trustworthiness of AI-powered AS in healthcare.
• To develop a comprehensive framework for assessing the trustworthiness of AI-powered AS in healthcare settings.
• To enhance confidence in the deployment of AI-driven AS within the healthcare domain.

Main Methods:

• Conducted semi-structured interviews with domain experts.
• Gathered qualitative insights on the multifaceted nature of AI-powered AS trustworthiness.
• Synthesized expert opinions to inform framework development.

Main Results:

• Identified key factors and challenges in assessing AI-powered AS trustworthiness in healthcare.
• Developed a novel, expert-informed framework for trustworthiness assessment.
• Provided a structured approach for evaluating AI in healthcare.

Conclusions:

• The proposed framework offers a robust method for evaluating AI-powered AS trustworthiness in healthcare.
• Expert insights are vital for developing comprehensive and context-specific assessment tools.
• Advancing trustworthiness assessment will foster safer and more reliable AI adoption in healthcare.