Exploring Artificial Intelligence Biases in Predictive Models for Cancer Diagnosis

The American Society of Clinical Oncology (ASCO) has released the principles for the responsible use of artificial intelligence (AI) in oncology emphasizing fairness, accountability, oversight, equity, and transparency. However, the extent to which these principles are followed is unknown. The goal of this study was to assess the presence of biases and the quality of studies on AI models according to the ASCO principles and examine their potential impact through citation analysis and subsequent research applications. A review of original research articles centered on the evaluation of predictive models for cancer diagnosis published in the ASCO journal dedicated to informatics and data science in clinical oncology was conducted. Seventeen potential bias criteria were used to evaluate the sources of bias in the studies, aligned with the ASCO's principles for responsible AI use in oncology. The CREMLS checklist was applied to assess the study quality, focusing on the reporting standards, and the performance metrics along with citation counts of the included studies were analyzed. Nine studies were included. The most common biases were environmental and life-course bias, contextual bias, provider expertise bias, and implicit bias. Among the ASCO principles, the least adhered to were transparency, oversight and privacy, and human-centered AI application. Only 22% of the studies provided access to their data. The CREMLS checklist revealed the deficiencies in methodology and evaluation reporting. Most studies reported performance metrics within moderate to high ranges. Additionally, two studies were replicated in the subsequent research. In conclusion, most studies exhibited various types of bias, reporting deficiencies, and failure to adhere to the principles for responsible AI use in oncology, limiting their applicability and reproducibility. Greater transparency, data accessibility, and compliance with international guidelines are recommended to improve the reliability of AI-based research in oncology.