Related Experiment Video
Updated: Jul 3, 2026

Evidence-based Knowledge Synthesis and Hypothesis Validation: Navigating Biomedical Knowledge Bases via Explainable AI and Agentic Systems
Published on: June 13, 2025
Data-hugging shields proprietary AI models from research that could disprove them
Anish Karpurapu1, Zhicheng Guo2, Xiao Hu3
1Medical Scientist Training Program, Duke University School of Medicine, Durham, NC USA.
None:
"Data hugging" blocks independent verification of medical AI. Apple claims age estimation with a mean absolute error of 2.9 years using photoplethysmographic (PPG) signals. Given PPG's noise, such accuracy is questionable, raising concerns about other tech companies' claims. Using UK Biobank data, we find this accuracy unreplicable, achieving results only marginally better than predicting mean age. We advocate for curated public benchmark datasets and evaluation platforms to protect the public from unverifiable claims.