Interobserver agreement in assigning IOTA color score to adnexal masses using three-dimensional volumes or digital...

To estimate the interobserver agreement between a trainer and trainees in assigning the International Ovarian Tumor Analysis (IOTA) color score to adnexal masses using three-dimensional (3D) volumes and videoclips.

Fifty-one digital videoclips and 3D volumes of a non-consecutive series of adnexal masses were used for this study. One trainer and four trainees evaluated first the 3D volume and 1 week later a videoclip from the same mass. They had to assign IOTA color scores according to their impression of the amount of color content in each case. Interobserver agreement between trainer and trainees was assessed using Cohen's weighted kappa index with 95% CIs and percentage of agreement.

When using 3D volumes, interobserver agreement was good for three out of four pairs of comparisons and very good for one (kappa values of 0.70, 0.68, 0.81 and 0.71 for trainees A, B, C and D, respectively). When using videoclips, interobserver agreement was very good for two out of four pairs of comparisons and good for two (kappa values of 0.84, 0.80, 0.68 and 0.86 for Trainees A, B, C and D, respectively).

Evaluation of IOTA color scores in adnexal masses using either videoclips or 3D volumes is reproducible even in the hands of trainees after a short training program.