Related Experiment Video
Updated: Jul 12, 2025

A Knowledge Graph Approach to Elucidate the Role of Organellar Pathways in Disease via Biomedical Reports
Published on: October 13, 2023
Examining the Potential of ChatGPT on Biomedical Information Retrieval: Fact-Checking Drug-Disease Associations
Zhenxiang Gao1, Lingyao Li2, Siyuan Ma3
1Center for Artificial Intelligence in Drug Discovery, School of Medicine, Case Western Reserve University, Cleveland, OH, USA.
Abstract:
Large language models (LLMs) such as ChatGPT have recently attracted significant attention due to their impressive performance on many real-world tasks. These models have also demonstrated the potential in facilitating various biomedical tasks. However, little is known of their potential in biomedical information retrieval, especially identifying drug-disease associations. This study aims to explore the potential of ChatGPT, a popular LLM, in discerning drug-disease associations. We collected 2694 true drug-disease associations and 5662 false drug-disease pairs. Our approach involved creating various prompts to instruct ChatGPT in identifying these associations. Under varying prompt designs, ChatGPT's capability to identify drug-disease associations with an accuracy of 74.6-83.5% and 96.2-97.6% for the true and false pairs, respectively. This study shows that ChatGPT has the potential in identifying drug-disease associations and may serve as a helpful tool in searching pharmacy-related information. However, the accuracy of its insights warrants comprehensive examination before its implementation in medical practice.
More Related Videos
Related Concept Videos
Factors Influencing Drug Absorption: Disease States and Pharmacology
Substances such as alcohol and specific drugs, including antineoplastics, can also negatively impact drug absorption. For instance,...
Drug Biotransformation: Overview
Protein-protein Interfaces
Genome-wide Association Studies-GWAS
GWAS does not require the identification of the target gene involved in...
Drug Discovery: Overview
Single Nucleotide Polymorphisms-SNPs

