Prompting Strategies for Large Language Models in Primary Care: A Primer for Clinician-Artificial Intelligence...

Primary care is a language-intensive environment where clinicians frequently synthesize, document, and communicate large amounts of information. Given the amount of information in primary care, large language models (LLMs) have emerged as tools to support primary care clinician workflows, aiming to reduce administrative burden and augment patient care. LLMs are artificial intelligence tools that can generate text and assist with chart summarization, message drafting, and clinical decision support. However, because LLMs are probabilistic, identical inputs may yield inconsistent responses. The LLMs output can be significantly improved through prompt engineering. Prompt engineering is the intentional design of text entered into the LLM to help produce better LLM results. Prompting is best approached as an iterative process where a clinician defines the task, the LLM generates output, and the clinician critically reviews and refines the results. Low-quality prompts are often vague and produce generic or misleading responses. High-quality prompts are specific, context-rich, and well-structured. Using structured prompting frameworks can improve the LLMs response. Including core elements, such as the LLMs role, the clinical context, the requested task, and the desired output formatting, can help improve the LLMs response by providing situational background and framing response formatting. Additional frameworks, such as Ask-Context-Expectation and PICO+O, can be utilized for specific patient circumstances and cases. However, despite their promise, LLMs have important limitations. They may generate inaccurate or hallucinated information and produce inconsistent results. Given these limitations, LLMs should not be viewed as knowledge authorities but rather as cognitive assistants. Thoughtful prompt design can help reduce these limitations and improve response accuracy, always keeping in mind that LLMs should not replace human judgment or clinical reasoning. As LLMs continue to be integrated into primary care, prompt engineering will become an increasingly important clinical skill. Careful prompt design and critical appraisal of LLM responses will be key to maintaining excellent patient care in the AI era.