Related Experiment Video
Updated: Jun 3, 2025
An In Vitro Caseum Binding Assay that Predicts Drug Penetration in Tuberculosis Lesions
Published on: May 8, 2017
Recommended antibiotic treatment agreement between infectious diseases specialists and ChatGPT®
Santiago Montiel-Romero1, Sandra Rajme-López1, Carla Marina Román-Montes1,2
1Department of Infectious Diseases, Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán, Mexico City, Mexico, 15 Vasco de Quiroga, Belisario Domínguez Secc 16 Tlalpan, Mexico City, 14080.
Background:
Antimicrobial resistance is a global threat to public health. Chat Generative Pre-trained Transformer (ChatGPT®) is a language model tool based on artificial intelligence. ChatGPT® could analyze data from antimicrobial susceptibility tests in real time, especially in places where infectious diseases (ID) specialists are not available. We aimed to evaluate the agreement between ChatGPT® and ID specialists regarding appropriate antibiotic prescription in simulated cases.
Methods:
Using data from microbiological isolates recovered in our center, we fabricated 100 cases of patients with different infections. Each case included age, infectious syndrome, isolated organism and complete antibiogram. Considering a precise set of instructions, the cases were introduced into ChatGPT® and presented to five ID specialists. For each case, we asked, (1) "What is the most appropriate antibiotic that should be prescribed to the patient in the clinical case?" and (2) "According to the interpretation of the antibiogram, what is the most probable mechanism of resistance?". We then calculated the agreement between ID specialists and ChatGPT®, as well as Cohen's kappa coefficient.
Results:
Regarding the recommended antibiotic prescription, agreement between ID specialists and ChatGPT® was observed in 51/100 cases. The calculated kappa coefficient was 0.48. Agreement on antimicrobial resistance mechanisms was observed in 42/100 cases. The calculated kappa coefficient was 0.39. In a subanalysis according to infectious syndromes and microorganisms, Agreement (range 25 - 80%) and kappa coefficients (range 0.21-0.79) varied.
Conclusion:
We found poor agreement between ID specialists and ChatGPT® regarding the recommended antibiotic management in simulated clinical cases.
More Related Videos
11:17Multiplex Therapeutic Drug Monitoring by Isotope-dilution HPLC-MS/MS of Antibiotics in Critical Illnesses
Published on: August 30, 2018
08:04Quantitative Examination of Antibiotic Susceptibility of Neisseria gonorrhoeae Aggregates Using ATP-utilization Commercial Assays and Live/Dead Staining
Published on: February 8, 2019
Related Concept Videos
01:28Pulmonary Tuberculosis V
Latent tuberculosis infection occurs when TB bacteria are present in a person's body, but are not causing illness or symptoms. It is not contagious, and preventive treatment is crucial to avoid the...
00:57Antibiotic Selection
01:17Transmission-based Precautions I: Contact, Enteric, and Droplets
Contact Precautions:
Contact precautions are the measures taken to prevent the transmission of infectious agents, especially epidemiologically important microorganisms such as MRSA or influenza, primarily transmitted through direct or indirect contact with an...
01:30Acute Pharyngitis
Acute pharyngitis is the inflammation of the back of the throat (pharynx), commonly resulting in a sore throat. It is a frequently encountered condition that prompts individuals to seek medical advice.
Classification
Acute pharyngitis can be categorized based on its underlying cause:
01:16Treating Helicobacter pylori in Peptic Ulcers: Antimicrobial Therapy
01:27Combined Effects of Drugs: Synergism
Such synergistic combinations...