Interobserver Reliability of the Antenatal Consensus Classification System for Urinary Tract Dilatation

The consensus classification system for urinary tract dilatation (UTD) was designed to be more objective and reproducible than previously used systems. We sought to evaluate interobserver reliability of UTD components and overall scores in a prenatal population undergoing third-trimester ultrasound examinations.

We retrospectively identified patients who underwent antenatal ultrasound examinations for UTD between 28 and 40 weeks' gestation. All images from individual studies of 300 fetuses were reviewed independently by 5 experienced sonologists (1 maternal-fetal medicine specialist and 4 radiologists). Urinary tract dilatation scores (normal, A1, or A2/3) and Society for Fetal Urology (SFU) scores were assigned. Interobserver agreement between raters was evaluated with the Fleiss κ statistic.

Overall interobserver agreement for the antenatal UTD risk score showed substantial agreement among all 5 readers (κ = 0.657 [95% confidence interval, 0.632, 0.683]; P < .001). All 5 readers applied the same UTD risk score in 53.7% of cases. Some variability in the antenatal UTD score and individual elements was observed. At least 2 UTD risk scores were assigned to a specific individual patient in 46.3% of cases (139 of 300), and all 3 UTD risk scores were assigned to a specific individual patient in 1.7% of cases (5 of 300). In 18.0% of cases (54 of 300), at least 2 readers assigned a UTD score different from that assigned by the other readers. Agreement was lowest for parenchymal appearance (κ = 0.225). Agreement for the SFU system was fair (κ = 0.368; P < .001).

Interobserver agreement for the antenatal UTD grading system was substantial. Compared to the SFU system, the antenatal UTD system showed better agreement among readers.