Related Experiment Video

Updated: Mar 28, 2026

Laser Capture Microdissection of Highly Pure Trabecular Meshwork from Mouse Eyes for Gene Expression Analysis

Laser Capture Microdissection of Highly Pure Trabecular Meshwork from Mouse Eyes for Gene Expression Analysis

Published on: June 3, 2018

Comparing the Accuracy of 4 Artificial Intelligence Models in PubMed Citation Generation for Glaucoma Research

Mustafa Civelekler¹, Mehmet Citirik

¹Department of Ophthalmology, University of Health Sciences, Ankara Etlik City Hospital, Ankara, Turkey.

Journal of Glaucoma

|March 26, 2026

Abstract

Prcis:

DeepSeek, a biomedically enriched AI model, achieved the highest accuracy in generating PubMed citations for glaucoma research, outperforming general-purpose models and highlighting the necessity of human oversight to mitigate AI-related citation errors.

Purpose:

This study evaluated the accuracy and reliability of 4 artificial intelligence (AI) models-ChatGPT (OpenAI GPT-3.5), Copilot (GitHub/Microsoft), DeepSeek (DeepSeek AI), and Gemini (Google AI)-in generating PubMed citations for glaucoma research. This study aimed to assess the potential of AI tools for academic reference generation and identify their limitations, particularly in specialized ophthalmology fields.

Methods:

Thirty-five standardized clinical paragraphs from the Review of Ophthalmology (fourth edition) were used to test citation accuracy. Each model was instructed to generate AMA 11-style PubMed citations. Citations were evaluated for accuracy, DOI matching, and clinical relevance. An expert review validated the outputs and classified them as "Fully Cited," "Partially Cited," or "Not Cited."

Results:

DeepSeek, a biomedically enriched model, outperformed the others, with an accuracy of 92.0%. Copilot and Gemini achieved moderate accuracies of 66.7% and 25.8%, respectively, while ChatGPT achieved the lowest citation accuracy at 19.4%. Frequent errors included DOI mismatches, incorrect journal names, and irrelevant references. Expert review confirmed that even the best model produced citation errors, emphasizing the need for human oversight. We interpret this apparent advantage cautiously, as model details, updates, and changes in underlying data may influence performance.

Conclusion:

AI models-particularly biomedically enriched tools such as DeepSeek-can accelerate citation drafting, but citation hallucinations and metadata errors remain common. AI should serve as a decision support tool for reference retrieval and formatting, not a substitute for rigorous manual verification before submission.

Keywords:

PubMed citations artificial intelligence citation accuracy glaucoma disease ophthalmology

More Related Videos

Full-Circle Cauterization of Limbal Vascular Plexus for Surgically Induced Glaucoma in Rodents

Full-Circle Cauterization of Limbal Vascular Plexus for Surgically Induced Glaucoma in Rodents

Published on: February 15, 2022

A Magnetic Microbead Occlusion Model to Induce Ocular Hypertension-Dependent Glaucoma in Mice

A Magnetic Microbead Occlusion Model to Induce Ocular Hypertension-Dependent Glaucoma in Mice

Published on: March 23, 2016

Related Concept Videos

Glaucoma: Overview

Glaucoma: Overview

Glaucoma is an eye condition characterized by increased intraocular pressure that damages the retina and optic nerve, leading to irreversible blindness if left untreated. The human eye has various components, including the cornea, iris, pupil, lens, and optic nerve. Aqueous humor is secreted by the epithelium of the ciliary body in the posterior chamber and flows through the trabecular meshwork and canal of Schlemm, maintaining normal intraocular pressure. The trabecular meshwork and the canal...

Open Angle Glaucoma: Treatment

Open Angle Glaucoma: Treatment

In open-angle glaucoma, the iridocorneal angle remains open, but the trabecular meshwork becomes stiff, slowing down the outflow of aqueous humor. This causes a buildup of aqueous humor in the anterior chamber, leading to a sudden increase in intraocular pressure. The treatment for open-angle glaucoma focuses on reducing the elevated intraocular pressure by either decreasing the secretion of aqueous humor or increasing its outflow.
Drugs such as carbonic anhydrase inhibitors, α2- and...

Angle Closure Glaucoma: Treatment

Angle Closure Glaucoma: Treatment

Angle-closure glaucoma, or closed-angle glaucoma, is an eye condition where the iris bulges out and blocks the iridocorneal angle, resulting in a buildup of aqueous humor and increased intraocular pressure. Immediate medical attention is necessary due to the sudden onset of symptoms. The treatment for angle-closure glaucoma includes short-term and long-term approaches. Short-term treatment involves using eye drops like pilocarpine to lower intraocular pressure by increasing aqueous humor...

Mouse Models of Cancer Study

Mouse Models of Cancer Study

Mice have long served as models for studying human biology and pathology because of their phylogenetic and physiological similarity with humans. They are also easy to maintain and breed in the laboratory, and hence, many inbred strains are now available for research. Studies on mice have contributed immeasurably to our understanding of cancer biology.
The development of transgenic, knockout, and knock-in mice has led to an exponential increase in their use as model organisms in research,...

Articles linked to this work by shared authors, journal, and citation graph.

Optical Coherence Tomography Features and Multimodal Imaging Findings in Choroidal Osteoma: A Case Series.

Ocular oncology and pathology·2026

Comparative analysis of RNFL and optic disc measurements across three OCT devices in healthy eyes: Implications for device standardization and clinical practice.

Indian journal of ophthalmology·2026

When the Clinical Picture Demands More: Dual Diagnosis of Neurofibromatosis Type 1 and Auriculocondylar Syndrome 2A in a Pediatric Case.

Molecular syndromology·2026

Molecular Genetic Confirmation of Jaffe-Campanacci Syndrome: A Case Report of the Third Identified Pathogenic NF1 Variant.

Molecular syndromology·2026

Radial peripapillary capillary changes and retinal nerve fiber layer alterations in diabetic foot ulcers with mild-to-moderate nonproliferative diabetic retinopathy: an OCTA study.

Turkish journal of medical sciences·2026

Exploring Artificial Intelligence's Role in Citation Generation for Ocular Inflammation and Uveal Diseases Research: A Comparative Evaluation Across Four Models.

Ocular immunology and inflammation·2026

See all related articles