Related Experiment Video
Updated: Oct 17, 2026

Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
A multi-agent large language model (LLM) platform for structured medical anamnesis in outpatient care
Elena Zaitseva1, Simon Ochotnicky1, Miriam Fandakova1
1Faculty of Management Science and Informatics, University of Zilina, Zilina, Slovakia.
Introduction:
Medical anamnesis is fundamental to clinical decision-making, yet outpatient consultations often provide limited time for systematic information collection. This study investigates whether structured anamnesis acquisition can be redistributed to a pre-consultation phase using a framework-driven large language model (LLM) platform.
Methods:
We developed Symptio, a proof-of-concept multi-agent LLM platform that operationalises the SOCRATES, Review of Systems, and SAMPLE frameworks as machine-interpretable constraints within a human-in-the-loop workflow. The system was evaluated in 100 simulated outpatient scenarios. Generated anamneses were compared with reference-standard representations using structural agreement and field-level performance metrics.
Results:
Full structural agreement across all three frameworks was achieved in 87% of scenarios. Framework-specific agreement reached 96% for SOCRATES, 88% for Review of Systems, and 93% for SAMPLE. Micro-averaged precision, recall, and F1-score were 99.04%, 98.54%, and 98.79%, respectively. Although no high-severity errors were identified, 58 field-level discrepancies, including 28 medium-severity errors, were observed, supporting the need for physician review of all outputs.
Discussion:
The findings demonstrate the technical feasibility of acquiring structured anamnesis in a framework-driven manner within a process-oriented multi-agent LLM architecture under controlled conditions. The proposed approach enables the relocation of routine information collection to a pre-consultation phase while preserving physician authority through human-in-the-loop validation. Further studies are required to evaluate clinical safety, workflow impact, and effectiveness in real-world settings.
Related Concept Videos
Methods of Documentation VI: Case Management Model
For example, a patient with a chronic illness...
Methods of Documentation II: POMR
Documentation in Long-Term and Home Healthcare Setting
Long-Term Care Facilities
Introduction to Language of Pathophysiology ll
Introduction to Language of Pathophysiology l