AI Chatbots in Oncology: A Comparative Study of Sider Fusion AI and Perplexity AI for Gastric Cancer Patients

The integration of AI chatbots in healthcare, particularly for young adults diagnosed with gastric cancer, offers a novel approach to enhancing patient support and information access. This evaluation examines the effectiveness of two AI chatbots, Sider Fusion AI Bot, and Perplexity AI, in improving patient outcomes, alleviating anxiety, and promoting informed decision-making. A comparative study design was employed, utilizing a structured rubric guided by experienced gastroenterologists to assess the performance of both chatbots. Evaluation criteria included competency, accuracy, relevance, informativeness, and support capabilities. The study focused on a case involving a 21-year-old male with advanced gastric adenocarcinoma. Both chatbots demonstrated high competency and relevance scores, achieving perfect scores of 5. However, they received low accuracy scores of 1, indicating a need for scrutiny in specific details. Sider Fusion AI Bot excelled in informativeness (score of 5) and support capabilities (rated "high"), while Perplexity AI scored 4 in informativeness and was rated "moderate" for support. Both systems provided essential recommendations for alleviating anxiety and emphasized informed decision-making, but Sider Fusion AI Bot offered a more comprehensive discharge plan. The study highlights the strengths and weaknesses of AI chatbots in oncology, emphasizing the importance of tailored communication styles to enhance patient engagement and outcomes. Sider Fusion AI Bot's superior capacity for detailed explanations and user engagement positions it as a potentially more valuable tool in clinical decision-making. Ongoing research is necessary to address limitations and optimize the integration of AI chatbots in healthcare settings, ensuring they effectively complement human interactions.