Information leaflets vs artificial intelligence: comparing perceptions of stroke survivors and professionals in a...

Stroke survivors describe insufficient access to information post-discharge. We aimed to compare user perceptions of stroke information from third-sector stroke websites with those generated by a widely accessible artificial intelligence (AI) tool and to summarise the attributes of the preferred stroke information formats.

UK third-sector stroke websites were searched for materials relevant to 15 questions asked by stroke survivors. ChatGPT-4o was used to generate responses. Stroke professionals (clinicians, researchers), stroke survivors and caregivers reviewed third-sector and AI responses, guessing the source and identifying their preferred text. Participants rated responses on scales of empathy, trustworthiness, reliability, comprehensibility and usefulness and provided justification. Proportions of preference and correct guesses, as well as mean ratings, were compared between groups. Framework analysis was used to identify the attributes of response formats preferred by stroke survivors.

Relevant responses were found for 13 (87%) of 15 questions. Across groups, 60 participants with a mean age of 44 (SD = 14) and 57% females, correctly identified 184/300 (61%) of AI responses, and preferred AI in 123/300 (46%) of the cases. The groups differed in preference, with clinicians being least likely to choose AI (34%), followed by stroke survivors (49%) and researchers (54%). Stroke professionals viewed third-sector responses as more empathetic. The themes of content, structure and tone of responses were described with an emphasis on clarity, conciseness and an approachable tone.

Artificial intelligence-generated responses to stroke questions were rated positively by stroke survivors and researchers, whereas stroke clinicians were more sceptical.

Widely accessible generic AI tools have the potential to complement existing stroke information resources.