Related Experiment Video
Updated: Jul 17, 2025

A Postoperative Evaluation Guideline for Computer-Assisted Reconstruction of the Mandible
Published on: January 28, 2020
Assessing the accuracy of ChatGPT references in head and neck and ENT disciplines
Andrea Frosolini1, Leonardo Franz2,3, Simone Benedetti4
1Department of Maxillo-Facial Surgery, Policlinico Le Scotte, University of Siena, Siena, Italy. andreafrosolini@gmail.com.
Purpose:
ChatGPT has gained popularity as a web application since its release in 2022. While artificial intelligence (AI) systems' potential in scientific writing is widely discussed, their reliability in reviewing literature and providing accurate references remains unexplored. This study examines the reliability of references generated by ChatGPT language models in the Head and Neck field.
Methods:
Twenty clinical questions were generated across different Head and Neck disciplines, to prompt ChatGPT versions 3.5 and 4.0 to produce texts on the assigned topics. The generated references were categorized as "true," "erroneous," or "inexistent" based on congruence with existing records in scientific databases.
Results:
ChatGPT 4.0 outperformed version 3.5 in terms of reference reliability. However, both versions displayed a tendency to provide erroneous/non-existent references.
Conclusions:
It is crucial to address this challenge to maintain the reliability of scientific literature. Journals and institutions should establish strategies and good-practice principles in the evolving landscape of AI-assisted scientific writing.
Related Concept Videos
Assessment of Airway, Skin Color, and Use of Accessory Muscles
Introduction
The initial evaluation of a patient's respiratory system...
Arteries of the Head and Neck
The internal carotid arteries supply blood to the anterior portion of the cerebrum. They enter the...
Veins of Head and Neck
On the other hand, the vertebral veins, unlike their arterial counterparts, are not primarily responsible for brain drainage. Instead, they drain the cervical vertebrae, spinal cord, and some small...
Physical Assessment of the Respiratory Tract I: Health History
Subjective Data
Subjective data provides vital information about the patient's health history and symptoms. This data is typically collected through interviews in which patients describe their experiences, symptoms, and concerns.
Health history and...

