Reproducibility of diffusion, shape, and connectivity metrics across scanners: Implications for multi-site tractography

Multi-site diffusion MRI studies face scanner-induced variability that can obscure biological signal. Harmonization methods such as ComBat have been developed to address this, but have been evaluated primarily on diffusion scalar metrics. Whether scanner reproducibility differs across fundamentally distinct tract-derived representations has not been systematically compared. Here, we compared the reproducibility of three metric families (diffusion, shape, and connectivity) across 36 association tracts using the MASiVar dataset (5 subjects, 4 scanners, 27 sessions). We assessed intraclass correlation coefficients (ICC) and multivariate subject discrimination at baseline, under dimensionality reduction, and after ComBat harmonization. At baseline, shape metrics showed the highest scanner reproducibility (median ICC 0.69), followed by connectivity (0.49) and diffusion (0.34). Shape and connectivity achieved comparable subject discrimination (both 1.75), significantly exceeding diffusion (1.23). ComBat harmonization improved all families but harmonized diffusion (0.58) remained below unharmonized shape (0.69), indicating that metric family selection remains consequential even after harmonization. Under low-dimensional representation, connectivity showed the largest gains (ICC 0.86, subject discrimination 3.0), exceeding other families at any dimensionality. Analysis of principal component loadings identified a small number of cortical regions per tract (median 6) that capture 95% of the reproducible connectivity signal, providing a per-tract reference for selecting the most informative regions in future multi-site studies. These findings indicate that the choice of which tract-derived metrics to analyze in multi-site studies deserves at least as much consideration as how to harmonize them.