Interreader Agreement and Intermodality Concordance of O-RADS US and MRI for Assessing Large, Complex Ovarian-Adnexal...

Purpose To assess interreader agreement of the Ovarian-Adnexal Reporting and Data System (O-RADS) and intermodality concordance between US and MRI for characterizing complex adnexal cysts measuring 5 cm or larger. Materials and Methods This retrospective study included 58 "complex cysts" measuring at least 5 cm in size observed at both US and MRI in 54 women (median age, 37 years ± 12 [SD]; seven postmenopausal women) between July 2017 and June 2020, identified from an electronic US database. A separate set of two blinded radiologists independently reviewed the US or MR images to assign the O-RADS category, and an adjudicator resolved discrepancies (a total of six readers). Lesion outcome (49 benign, eight malignant, one lost to follow-up) was recorded. Interreader agreement of O-RADS US and O-RADS MRI and concordance between US and MRI were analyzed. Results Interreader agreement was fair for US (κ = 0.31), moderate for MRI (κ = 0.43), and moderate between US and MRI (κ = 0.58). A significant positive correlation was found between O-RADS US and MRI (τ = 0.72, P < .001). The O-RADS 4 threshold yielded the highest accuracy for both US and MRI (area under the receiver operating characteristic curve = 0.92 and 0.995, respectively). Considering O-RADS US 4 or 5 as potentially malignant and 1-3 as benign, eight lesions that were assessed as potentially malignant at US were correctly downgraded to benign by using findings at MRI. Using findings at MRI, one malignant lesion that was assessed as benign at US was upgraded to potentially malignant. Conclusion O-RADS US and MRI had excellent performance and positive correlation, but significant interobserver variability remains. Keywords: Ovary, MR Imaging, Ultrasonography © RSNA, 2022 See also the commentary by Baumgarten in this issue.