Related Experiment Video
Updated: Jan 27, 2026

A User-friendly and Powerful R Analysis of Large-scale Datasets
Published on: November 4, 2025
AICM: A Genuine Framework for Correcting Inconsistency Between Large Pharmacogenomics Datasets
Zhiyue Tom Hu1, Yuting Ye, Patrick A Newbury
1Department of Biostatistics, University of California, Berkeley, USA, zyhu95@berkeley.edu.
Abstract:
The inconsistency of open pharmacogenomics datasets produced by different studies limits the usage of such datasets in many tasks, such as biomarker discovery. Investigation of multiple pharmacogenomics datasets confirmed that the pairwise sensitivity data correlation between drugs, or rows, across different studies (drug-wise) is relatively low, while the pairwise sensitivity data correlation between cell-lines, or columns, across different studies (cell-wise) is considerably strong. This common interesting observation across multiple pharmacogenomics datasets suggests the existence of subtle consistency among the different studies (i.e., strong cell-wise correlation). However, significant noises are also shown (i.e., weak drug-wise correlation) and have prevented researchers from comfortably using the data directly. Motivated by this observation, we propose a novel framework for addressing the inconsistency between large-scale pharmacogenomics data sets. Our method can significantly boost the drug-wise correlation and can be easily applied to re-summarized and normalized datasets proposed by others. We also investigate our algorithm based on many different criteria to demonstrate that the corrected datasets are not only consistent, but also biologically meaningful. Eventually, we propose to extend our main algorithm into a framework, so that in the future when more datasets become publicly available, our framework can hopefully offer a "ground-truth" guidance for references.
Related Concept Videos
Distance Corrections
Power Factor Correction
NMR Spectrometers: Resolution and Error Correction
Schemas
Uncertainty in Measurement: Accuracy and Precision
Persuasion Strategies

