Pilot Study of a Web-based Decision Tool on Post-operative Use of Radioactive Iodine

Background: The Thyroid Cancer Care Collaborative developed a web-based clinical decision-making module (CDMM) to inform risk-adjusted decisions on post-thyroidectomy radioactive iodine (RAI) use in papillary thyroid cancer (PTC). Methods: In a pilot study, we evaluated the CDMM in 19 PTC cases representing low- (five), intermediate- (seven) and high-risk (seven) disease. Two PTC experts and 10 PTC physicians reviewed cases and assigned risk level and RAI recommendation. The experts used a standard approach while the others used the CDMM. We assessed agreement between responses using a weighted Kappa. Results: Between experts, risk-assignment was concordant in 100%, 57% and 86% of low-, intermediate- and high-risk cases, respectively. Between CDMM users, risk-assignment was concordant in 100%, 29% and 14% in low-, intermediate- and high-risk cases, respectively (p=0.01). CDMM-assigned risk agreed with the expert-assigned risk in 100%, 25% and 0% of low-, intermediate- and high-risk cases, respectively (Kappa=0.69). For RAI use, the experts agreed in 15 cases while CDMM users agreed in eight. On further analysis, interpretation of extrathyroidal extension and lymph node staging led to discrepancies with the CDMM. Conclusions: For a web-based CDMM to accurately inform appropriate use of RAI in PTC, standard pathological and surgical reports are necessary.