Related Experiment Videos
Octave: Scale-Resolved Evaluation of Spatial Gene Expression Prediction from Histology
Abstract:
Spatial gene expression prediction from histology is typically evaluated by the mean per-gene Pearson correlation (PCC). PCC does not distinguish spatial scales: coarse tissue organisation alone can earn most of the score. A domain oracle makes this precise: given an image-derived partition of the tissue, the predictor that assigns each domain its measured mean expression is the best that any predictor constant on that partition can do. On a widely used benchmark with a ∼100 µ m pitch, a learnable version that estimates each domain's mean from training data reaches 82% of the PCC of a trained model, and a partition of the spot coordinates alone, given measured means, reaches 123%. At that pitch the score rewards coarse spatial structure whatever its source. We introduce O ctave , a scale-resolved evaluation that filters prediction and measurement into spatial bands with widths in micrometres and scores their agreement in each band. On 16 µ m Xenium data, differences that look modest under PCC grow at finer scales: at ∼20 µ m the oracle's shortfall relative to the trained model is 2.4 times its PCC shortfall at the median and exceeds it in all 13 specimens. Across 57 image encoders the finest band reorders 261 of the 1596 encoder pairs relative to PCC. The benchmark's own finest band is 50 µ m wide, coarser than the scale at which these differences appear, so no score on that pitch can directly validate finer structure. O ctave reports how well a model predicts spatial expression at each spatial scale.