Patient Perceptions and preferences for the disclosure of artificial intelligence generated draft replies to...

Since their public release, artificial intelligence-generated draft replies (GDRs) to patient portal messages have been rapidly adopted across healthcare systems. Concurrently, debate has arisen regarding the extent to which GDRs should be disclosed to patients. This qualitative interview study, using vignettes, examines adult patients' reactions to and preferences regarding written AI disclosure statements.

Semi-structured interviews were conducted with 30 adult portal users with no prior experience with GDRs. Participants were recruited from a patient research registry at a large academic health system. Eligible participants were stratified by age and educational attainment and randomly sampled. Participants shared their initial interpretations, reactions, and preferences regarding GDRs with written disclosure statements, using four case-based vignettes. Interview data were analyzed through an interpretivist epistemology and a systematic process of inductive code and category generation and synthesis.

Patient interpretations of disclosure statements suggested that written disclosure statements did not provide sufficient information to clarify how AI was used, with nearly half of participants unable to identify AI as the draft's writer. GDR disclosure statements elicited participant concerns about error, authorship, and depersonalization. Despite these concerns, most participants expressed a preference for disclosure practices, citing a perceived right to information, agency, and autonomy in their healthcare. Those participants who expressed the most concerns when presented with written disclosure statements argued for preemptive disclosure methods that facilitate education and trust building.

As healthcare systems establish best practices for transparency and disclosure of GDRs, accounting for evolving patient perspectives on AI will be crucial to maintaining patient trust and confidence. The reactions and preferences for disclosure methods outlined by participants in this study suggest that careful deliberation should be given not to whether to disclose, but how to disclose, as healthcare systems balance tensions between AI transparency and patient trust.