Related Experiment Video
Updated: Sep 25, 2026
Accuracy in Dental Medicine, A New Way to Measure Trueness and Precision
Published on: April 29, 2014
The accuracy of large language models in assessing tooth detection and identification, dental caries, periapical
M K Nasreen1, Paul Chalakkal, Harsh Ulhas Manerkar
1Department of Pedodontics and Preventive Dentistry, Goa Dental College and Hospital, Bambolim, Goa, India.
Background:
Various studies have evaluated the accuracy of large language models (LLMs) in the detection of periapical radiolucencies from adult radiographs and orthopantomographs. However, none have evaluated their efficacy in evaluating parameters from mixed dentition radiographs.
Aim:
The aim of this study was to evaluate the accuracy of GPT-5 (GT), Gemini 3 Pro (GP), and Sonar (SR) in assessing tooth detection and identification, dental caries, periapical status, and stages of tooth development.
Settings And Design:
A total of 93 mixed dentition radiographs from children aged 6-12 years were included. Two pediatric dentists evaluated anonymized radiographs and were blinded to the outputs generated by the LLM.
Methodology:
A standardized prompt-engineering framework was used to instruct the LLM. The outputs generated were recorded in a Microsoft Excel spreadsheet and compared with the reference standard established by the examiners.
Statistical Analysis Used:
Stata Statistical Software (Release 19), Cohen's kappa coefficient, Cochran's Q test, and McNemar's test were used for statistical analysis. Statistical significance was established at P < 0.05.
Results:
GP was found to have the highest accuracy in identifying teeth. GP showed the highest observed and expected agreements in identifying caries levels. GP was better at recognizing advanced carious lesions, while GT and SR were better at identifying sound teeth. None of the LLMs could identify periodontitis. GP showed the best overall performance in identifying tooth development.
Conclusions:
GP was found to have the highest accuracy for all parameters among the LLMs tested. However, all the LLMs were found to be inferior to expert human judgment.
More Related Videos
Related Concept Videos
01:15Teeth
In the bud stage, the tooth germ (an aggregation of cells) starts to form in the developing jawbone. During the cap stage, the tooth germ differentiates into enamel organ, dental papilla, and dental sac, which will later develop into the tooth's enamel, dentin and...
01:21Tooth Anatomy
The Crown, Neck, and Root
The visible part of the tooth is referred to as the crown. It's covered by enamel, the hardest substance in the human body. The crown is uniquely shaped for each type of tooth, allowing for different functions such as cutting, tearing, or grinding food.