Consistency and Reliability Analyses of a Comprehensive Index for the Evaluation of Teeth Alignment Performance

(1) Introduction: The purpose of this work was to describe a method and propose a novel accuracy index to assess orthodontic alignment performance. (2) Methods: Fifteen patients who underwent orthodontic treatment using directly printed clear aligners were recruited. The study sample included 12 maxillary and 10 mandibular arches, whose pre-treatment, predicted and post-treatment digital models were superimposed on the untreated posterior teeth by means of a best-fit surface-based registration, which was also used to transfer three anatomical landmarks, digitally labeled on the crown of each anterior moving tooth, from the pre-treatment to the predicted and post-treatment models. The Teeth Alignment Performance (TAP) index, quantifying how close the final landmarks were to their expected final position, was proposed as an accuracy index of both individual tooth and group of teeth movement, and its inter-examiner repeatability was tested. (3) Results: No systematic inter-rater discrepancy associated with TAP was observed (p > 0.05), not even when a slight systematic inter-rater difference in landmark labelling was detected (for the upper central incisors, p < 0.001). In addition, all Intra-class Correlation Coefficient (ICC) values showed excellent inter-rater agreement (>0.95), and the small Random Error of Measurement (REM), ranging from 1% for the arch TAP to 3% for the lower canine TAP, indicated that this accuracy index is highly repeatable. (4) Conclusions: The TAP index was proven to be comprehensive, consistent and reliable in assessing the performance of teeth alignment according to a digital plan. The proposed method is also suitable to be implemented in the clinical digital workflow.