Health consumers' ethical concerns towards artificial intelligence in Australian emergency departments

To investigate health consumers' ethical concerns towards the use of artificial intelligence (AI) in EDs.

Qualitative semi-structured interviews with health consumers, recruited via health consumer networks and community groups, interviews conducted between January and August 2022.

We interviewed 28 health consumers about their perceptions towards the ethical use of AI in EDs. The results discussed in this paper highlight the challenges and barriers for the effective and ethical implementation of AI from the perspective of Australian health consumers. Most health consumers are more likely to support AI health tools in EDs if they continue to be involved in the decision-making process. There is considerably more approval of AI tools that support clinical decision-making, as opposed to replacing it. There is mixed sentiment about the acceptability of AI tools influencing clinical decision-making and judgement. Health consumers are mostly supportive of the use of their data to train and develop AI tools but are concerned with who has access. Addressing bias and discrimination in AI is an important consideration for some health consumers. Robust regulation and governance are critical for health consumers to trust and accept the use of AI.

Health consumers view AI as an emerging technology that they want to see comprehensively regulated to ensure it functions safely and securely with EDs. Without considerations made for the ethical design, implementation and use of AI technologies, health consumer trust and acceptance in the use of these tools will be limited.