Differential impact of cognitive computing augmented by real world evidence on novice and expert oncologists

Cognitive computing point-of-care decision support tools which ingest patient attributes from electronic health records and display treatment options based on expert training and medical literature, supplemented by real world evidence (RWE), might prove useful to expert and novice oncologists. The concordance of augmented intelligence systems with best medical practices and potential influences on physician behavior remain unknown.

Electronic health records from 88 breast cancer patients evaluated at a USA tertiary care center were presented to subspecialist experts and oncologists focusing on other disease states with and without reviewing the IBM Watson for Oncology with Cota RWE platform.

The cognitive computing "recommended" option was concordant with selection by breast cancer experts in 78.5% and "for consideration" option was selected in 9.4%, yielding agreements in 87.9%. Fifty-nine percent of non-concordant responses were generated from 8% of cases. In the Cota observational database 69.3% of matched controls were treated with "recommended," 11.4% "for consideration", and 19.3% "not recommended." Without guidance from Watson for Oncology (WfO)/Cota RWE, novice oncologists chose 75.5% recommended/for consideration treatments which improved to 95.3% with WfO/Cota RWE. The novices were more likely than experts to choose a non-recommended option (P < .01) without WfO/Cota RWE and changed decisions in 39% cases.

Watson for Oncology with Cota RWE options were largely concordant with disease expert judged best oncology practices, and was able to improve treatment decisions among breast cancer novices. The observation that nearly a fifth of patients with similar disease characteristics received non-recommended options in a real world database highlights a need for decision support.