Will ChatGPT3 Substitute for us as Clozapine Experts?

Area of Science:

• Artificial Intelligence in Medicine
• Pharmacogenomics
• Clinical Toxicology

Background:

• ChatGPT3, a novel artificial intelligence program, was released on February 13, 2023.
• The study investigates AI's reliability in providing accurate clinical information, specifically regarding pharmacogenomics.

Purpose of the Study:

• To assess the accuracy and consistency of ChatGPT3's responses regarding clozapine dosing in African Americans.
• To evaluate the AI's ability to provide credible references for its claims.

Main Methods:

• ChatGPT3 was queried on February 18, 2023, and again one week later regarding clozapine metabolism in individuals of African ancestry.
• The AI's responses were analyzed for accuracy, consistency, and the validity of cited references.

Main Results:

• Initial responses from ChatGPT3 suggested higher clozapine metabolism in African Americans, citing plausible but fabricated references.
• Subsequent interactions revealed contradictory information, with the AI claiming lower metabolism and providing invalid or irrelevant citations.
• The AI misrepresented publication dates and author contributions to support its claims.

Conclusions:

• ChatGPT3 demonstrated significant unreliability, presenting a mix of accurate, distorted, and fabricated information.
• The AI exhibited a concerning lack of consistency, reversing its position on a critical clinical issue within a week.
• The findings underscore the risks of relying on current AI models for complex medical information without rigorous verification.