Related Experiment Video
Updated: May 10, 2025

Basophil Activation Test for Allergy Diagnosis
Published on: May 31, 2021
Can ChatGPT provide parent education for oral immunotherapy?
Jana Abi Rafeh1, Diana Toscano Rivero1, Bruce D Mazer2
1Translational Research in Respiratory Diseases Program, Meakins-Christie Laboratories, McGill University Health Centre Research Institute, Montréal, Québec, Canada; Division of Experimental Medicine, Faculty of Medicine and Health Sciences, McGill University, Montréal, Québec, Canada.
Background:
Oral Immunotherapy (OIT) has exhibited great potential in the treatment of food allergy. However, there is no global consensus on best practices of OIT. Parents of allergic children often struggle with concerns regarding OIT methodology, safety, and lack of accessible educational resources. ChatGPT is a generative artificial intelligence chatbot from OpenAI recognized for its ability to formulate human-like conversations. Although applications of artificial intelligence in medical settings continue to be explored, the effectiveness of ChatGPT as an educational resource remains unknown for OIT.
Objective:
To assess the accuracy of ChatGPT as a self-guided educational resource for parents with children undergoing OIT.
Methods:
A total of 14 common questions from parents regarding OIT were entered into ChatGPT version 3.5 and answers were copied verbatim. These responses were then categorized into basic, advanced, or medical, and evaluated by Allergy-Immunology health care practitioners from North America and the United Kingdom using a 10-point Likert scale. Response readability, understandability, and reproducibility were assessed using the Flesch Reading Ease and Flesch-Kincaid Grade level scores, the Patient Education Materials Assessment Tool, and natural language processing tools, respectively.
Results:
The average median rankings by the practitioners per category were 8.6, 8.4, and 7.8 for basic, advanced, and medical, respectively. ChatGPT responses exhibited low readability scores, corresponding with a high-grade reading level. Understandability was between 73% to 84%, with scores decreased owing to response complexity. When assessing reproducibility, ChatGPT responses achieved rates between 83% and 93%.
Conclusion:
Our results revealed that ChatGPT provides intelligible and comprehensive responses to patient questions. Health care practitioners polled were generally positive but identified important limitations.
Related Concept Videos
Transmission-based Precautions II: Airborne and Protective Environment
Airborne precautions:
Use airborne precautions when treating patients known or suspected to have diseases that spread through the air—for example, tuberculosis or measles. These organisms are present in smaller droplets expelled by an infected person and...
Suctioning the Oropharyngeal Airway
After assembling the equipment, the nurse should practice hand hygiene and don appropriate PPE according to infection control guidelines to avoid the...
Operant Conditioning Intervention
In operant conditioning, behaviors that are...
Enteral Nutrition I: Orogastric and Nasogartic Feeding
Orogastric (OG) and nasogastric (NG) feeding are two standard methods used for enteral nutrition. Enteral nutrition is often preferred over...
Tumor Immunotherapy
Oxygen Delivering System II: Venturi Mask and Transtracheal Oxygen
Venturi Mask
The Venturi mask, named after the Venturi effect, is designed to deliver precise oxygen concentrations. It consists of a large tube with an oxygen inlet that narrows down, causing a pressure drop that pulls air in through adjustable side ports. The mask is a lightweight,...

