Related Experiment Video
Updated: Apr 4, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Decoding Clinician Authorial Style: A Style-Informed Pipeline for Clinical Document Summary Generation with Large
Scott Zhao1, Abbas Alili1, Usman Afzaal2
1Wake Forest University.
Abstract:
Large language models (LLMs) can automate clinical document summary generation. However, even clinically accurate outputs often fail to reflect individual clinicians' writing styles, leading to substantial post-editing. We examine this stylistic gap using a multi-author corpus of de-identified clinical summaries. We propose a style-informed generation framework that extracts clinician-specific stylistic features through LLM feedback and applies a Train→Generate paradigm to produce personalized clinical summaries. Conventional metrics (ROUGE, BERTScore, cosine similarity) largely failed to distinguish intra-author from inter-author writing patterns, while Jaro-Winkler and BLEU demonstrated limited sensitivity. Targeted LLM-guided feature extraction-emphasizing rhythm, narration, and sentence or list structure-improved authorship classification up to 73% of accuracy. In blinded clinician A/B testing, GPT-4-generated drafts were preferred less often than original notes, whereas the Gemini 2.5 Pro pipeline produced drafts preferred at rates comparable to, and in some cases exceeding, clinician-authored summaries. While inherent hallucination risks were noted, they were mitigated via high-fidelity prompt engineering and explicit adherence to source-only data constraints. These results suggest that style-informed generation can reduce the style gap and produce clinically acceptable clinical summaries that better align with the clinician's voice.
Related Concept Videos
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic...
Improving Translational Accuracy
Improving Translational Accuracy
Clinical Trials: Overview
Clinical Trials
There are four phases in a clinical trial. A phase one...
Techniques of Therapeutic Communication II: Focusing, Paraphrasing, and Summarizing
This therapeutic technique can also be used when a patient brings up pertinent information during a health-related conversation. The...
