Related Experiment Video
Updated: May 24, 2026
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
Generating Human-Readable Labels for SNOMED CT Expressions with LLMs: A Study on Model Performance and Rater
Adel Bensahla1,2, Jamil Zaghir1,2, Yuanyuan Zheng1,2
1Division of Medical Information Sciences, Geneva University Hospitals, Geneva, Switzerland.
None:
Post-coordinated SNOMED CT expressions lack human-readable labels, hindering their use in analytics and representation learning. To address this issue, we evaluated labels for 100 SNOMED CT expressions generated by a large language model (LLM), which were blindly rated on semantic equivalence and phrasing quality by two clinical terminologists. While the LLM-generated labels achieved semantic equivalence comparable to official SNOMED CT terms, revealing primarily stylistic rather than conceptual errors, we found negligible interrater reliability between experts when rating novel post-coordinated expressions. This indicates that automated labeling is a viable approach, where the primary challenge is not model performance but the inherent subjectivity of the task itself. This suggests the objective could be reframed towards achieving semantic plausibility at scale, rather than replicating a single, definitive expert consensus.