Related Experiment Video
Updated: Jul 23, 2025
A Protocol for Rapid Post-mortem Cell Culture of Diffuse Intrinsic Pontine Glioma DIPG
Published on: March 7, 2017
ChatGPT in head and neck scientific writing: A precautionary anecdote
1Department of Plastic and Reconstruction Surgery, Chang Gung Memorial Hospital, Linkou, Taiwan; Division of Plastic and Reconstructive Surgery, Department of Surgery, Stanford University Hospital, Stanford, CA, USA.
Purpose:
To evaluate the accuracy of ChatGPT references in scientific writing relevant to head and neck surgery.
Materials And Methods:
Five commonly researched keywords relevant to head and neck surgery were selected (osteoradionecrosis of the jaws, oral cancer, adjuvant therapy for oral cancer, TORS, and free flap reconstruction in oral cancer). The AI chatbot was then asked to provide ten complete citations for each of the keywords. Two independent authors reviewed the results for accuracy and assigned each article a numerical score based on pre-selected criteria.
Results:
Among 50 total references provided by ChatGPT, only five (10 %) were found to have the correct title, journal, authors, year of publication, and DOI. Merely 14 % of the presented references had correct DOI. References regarding free flap reconstruction for oral cancer were the least accurate from all the five categories, with no correct DOI. Complete inter-rater agreement was noted while evaluating the citations.
Conclusion:
Only 10 % of the articles provided by ChatGPT, relevant to head and neck surgery, were correct. A high degree of academic hallucination was noted.
Related Concept Videos
01:26Arteries of the Head and Neck
The internal carotid arteries supply blood to the anterior portion of the cerebrum. They enter the...
01:19Veins of Head and Neck
On the other hand, the vertebral veins, unlike their arterial counterparts, are not primarily responsible for brain drainage. Instead, they drain the cervical vertebrae, spinal cord, and some small...