Related Experiment Video
Updated: Jan 29, 2026

Testing for Metacognitive Responding Using an Odor-based Delayed Match-to-Sample Test in Rats
Published on: June 18, 2018
Abstract:
An AI system powered by structured oncology data matched oncologists' treatment choices in more than 90% of real clinical queries, besting a standard large language model. By focusing on a narrowly defined task-genomics-guided therapy selection-the platform demonstrates a practical pathway for deploying reliable AI tools in precision oncology.
Insights
An AI system using structured oncology data accurately matched expert oncologists' treatment decisions for over 90% of clinical cases. This AI tool shows promise for reliable deployment in precision oncology, specifically for genomics-guided therapy selection.
Area of Science:
- Oncology
- Artificial Intelligence
- Genomics
Background:
- Precision oncology relies on integrating complex genomic data for treatment selection.
- Standard large language models (LLMs) face challenges in applying specialized medical knowledge accurately.
- There is a need for reliable AI tools to assist oncologists in data-driven treatment decisions.
Purpose of the Study:
- To evaluate the performance of an AI system in matching oncologists' treatment choices for genomics-guided therapy selection.
- To compare the AI system's accuracy against a standard large language model in a real-world clinical setting.
Main Methods:
- Development of an AI system utilizing structured oncology data.
- Testing the AI system on real clinical queries requiring genomics-guided therapy selection.
- Comparison of the AI system's treatment recommendations with those of oncologists and a standard LLM.
Main Results:
- The AI system successfully matched oncologists' treatment choices in over 90% of clinical queries.
- The AI system outperformed a standard large language model in this specific task.
- The AI system demonstrated high reliability in genomics-guided therapy selection.
Conclusions:
- AI systems powered by structured oncology data can reliably assist in precision oncology.
- Specialized AI platforms focused on specific tasks like genomics-guided therapy selection offer a practical deployment pathway.
- This approach validates the potential of AI to enhance clinical decision-making in oncology.
Related Concept Videos
Sign Test for Matched Pairs
To conduct the sign test, we first calculate the differences in...
Mate Choice
Uncertainty in Measurement: Accuracy and Precision
Wilcoxon Signed-Ranks Test for Matched Pairs
Personal Choice and Fate Attributions
Accuracy and Precision

