Related Experiment Videos
Evaluation of a Large Language Model Discharge Summary Hospital Course Tool: Improved Quality but Longer
Alexander J Dobek1, Fawaz Naeem1, Christina DeBenedictus2
1University of Miami Miller School of Medicine, Department of Medicine, Florida, United States, Miami.
Background:
No studies have examined the effect of artificial intelligence (AI)-generated hospital courses on discharge summary documentation time.
Objectives:
To evaluate the effect of an AI-generated hospital course tool on discharge summary edit time, quality, and clinician perceptions.
Methods:
Observational study between a "Pre-AI period" (March 16, 2025 to November 19, 2025) and a "Post-AI period" (November 20, 2025 to February 11, 2026). An AI hospital course tool using a GPT 4.1 model to generate a draft hospital course integrated into mandatory discharge summary templates on November 20, 2025. We included 8,298 hospitalized adults cared for by hospital medicine clinicians. The primary outcome was discharge summary edit time, defined as time from note creation to signature across all sessions. A subset of 27 encounters was reviewed for cohesiveness, comprehensiveness, conciseness, potential for harm, and overall quality. Thirty-six clinicians completed a survey assessing usability, efficiency, trustworthiness, and quality.
Results:
Implementation of the AI tool was not associated with a significant change in discharge summary edit time between study periods (6.60 [IQR 3.4-13.5] vs 6.28 [IQR 3.2-13.0] minutes, p=0.11). Among 2,206 encounters in the Post-AI period, edit time was longer when the AI tool was used (9.20 [IQR 4.9-16.3] vs 4.93 [IQR 2.5-9.7] minutes, p<0.001). In multivariable analysis, AI tool was associated with a 32% increase in edit time (95% CI 24%-41%, p < 0.001; adjusted R² = 0.34). Faculty review found AI-generated summaries had higher quality and lower harm scores but were less concise. 31 (86.1%) clinicians agreed the tool improved efficiency.
Conclusions:
Discharge summary edit time did not differ between study periods but was longer when the AI tool was used. However, there was increased perception of efficiency. The tool improved summary quality and reduced potential harm but may increase documentation time.
Related Concept Videos
Discharge Summary Forms
Here's a detailed look at the key components and guidelines for preparing a discharge summary:
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic illness...
Documentation in Long-Term and Home Healthcare Setting
Long-Term Care Facilities
Methods of Documentation V: CBE
In CBE, healthcare professionals establish predefined standards of practice that define what constitutes...
Guidelines for Nursing Documentation I
Factual:
The following points emphasize the significance of upholding accurate and unbiased documentation in healthcare.
Methods of Documentation III: PIE