AI-Based Detection of Dental Features on CBCT: Dual-Layer Reliability Analysis

Background/Objectives: Artificial intelligence (AI) systems may enhance diagnostic accuracy in cone-beam computed tomography (CBCT) analysis. However, most validations focus on isolated tooth-level tasks rather than clinically meaningful full-mouth assessment outcomes. To evaluate the diagnostic accuracy of a commercial AI platform for detecting dental treatment features on CBCT images at both tooth and full-scan levels. Methods: In this retrospective single-center study, 147 CBCT scans (4704 tooth positions) were analyzed. Two experienced readers annotated treatment features (missing teeth, fillings, endodontic treatments, crowns, pontics, orthodontic appliances, implants), and consensus served as the reference. Anonymized datasets were processed by a cloud-based AI system (Diagnocat Inc., San Francisco, CA, USA). Diagnostic metrics-sensitivity, specificity, positive predictive value (PPV), negative predictive value (NPV), and F1-score-were calculated with 95% patient-clustered bootstrap confidence intervals. A "Perfect Agreement" criterion defined full-scan level success as an entirely error-free full-mouth report. Results: Tooth-level AI performance was excellent, with accuracy exceeding 99% for most categories. Sensitivity was highest for missing teeth (99.3%) and endodontic treatments (99.0%). Specificity and NPV exceeded 98.5% and 99.7%, respectively. Full-scan level Perfect Agreement was achieved in 82.3% (95% CI: 76.2-88.4%), with errors concentrated in teeth presenting multiple co-existing findings. Conclusions: The evaluated AI platform demonstrates near-perfect accuracy in detecting isolated dental features but moderate reliability in generating complete full-mouth reports. It functions best as an assistive diagnostic tool, not as an autonomous system.