Related Experiment Video
Updated: Jun 17, 2025
03:14
Augmenting Large Language Models via Vector Embeddings to Improve Domain-Specific Responsiveness
Published on: December 6, 2024
527
Evaluation of Generative Language Models in Personalizing Medical Information: Instrument Validation Study
Aidin Spina1, Saman Andalib1, Daniel Flores1
1School of Medicine, University of California, Irvine, Irvine, CA, United States.
JMIR AI
|August 13, 2024
Summary
Generative language models (GLMs) can adapt medical text complexity for different education levels. GPT-4 shows better performance than GPT-3.5 in tailoring readability, but both have limitations in precise personalization for health literacy.
Area of Science:
- Artificial Intelligence in Medicine
- Natural Language Processing
- Health Literacy Research
Background:
- Generative language models (GLMs) offer potential for improving patient comprehension of medical information.
- GLMs can be deployed to address challenges associated with low health literacy.
Purpose of the Study:
- To evaluate the capability of ChatGPT-3.5 and GPT-4 to adjust medical text complexity based on patient education levels.
- To assess the utility of GLMs as tools for enhancing health literacy.
Main Methods:
- Developed input templates for type II diabetes and hypertension vignettes.
- Modified clinical text for different hypothetical patient education levels.
- Quantified readability using Flesch reading ease (FKRE) and Flesch-Kincaid grade level (FKGL) scores.
Main Results:
- GPT-4 demonstrated better performance than GPT-3.5 in tailoring text readability across educational levels.
- GPT-4 met target readability for most educational groups, while GPT-3.5 aligned only at the bachelor's level.
- Both models showed statistically significant differences in readability adjustments across education levels.
Conclusions:
- GLMs can modify medical text structure and readability based on specified education levels.
- Current GLMs categorize readability into broad tiers (easy, medium, difficult), indicating limitations in precise personalization.
- Further research is needed to enhance GLM reliability in personalizing medical texts for improved healthcare literacy.
Keywords:
AIGLMGLMsLHLNLPartificial intelligencecomprehensioneducationgenerativegenerative language modelhealth informationhealth literacyknowledge translationlanguage modellanguage modelslow health literacymedical informationmedical textmedical textsnatural language processingreadabilityreading levelreading levelsunderstandabilityunderstandable
Related Concept Videos
01:03Data Validation
5.0K
Data validation is an essential part of a comprehensive assessment. Validation is confirming or verifying and opening the door to gathering more assessment data as it clarifies vague or unclear data. The process of checking and verifying the collected information is called data validation. The primary purpose of data validation is to ensure data is as free from error, bias, and misinterpretation as possible.
Nursing assessment guides are generally based on holistic models rather than medical...
Nursing assessment guides are generally based on holistic models rather than medical...
5.0K
02:50Combination Therapies and Personalized Medicine
4.9K
Combining two or more treatment methods increases the life span of cancer patients while reducing damage to vital organs or tissue from the overuse of a single treatment. Combination therapy also targets different cancer-inducing pathways, thus reducing the chances of developing resistance to treatment.
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
The combination of the drug acetazolamide and sulforaphane is a good example of combination therapy to treat cancer. The cells in the interior of a large tumor often die due to the hypoxic and...
4.9K