Comparison of subtyping methods for neuroimaging studies in Alzheimer's disease: a call for harmonization

Biological subtypes in Alzheimer's disease, originally identified on neuropathological data, have been translated to in vivo biomarkers such as structural magnetic resonance imaging and positron emission tomography, to disentangle the heterogeneity within Alzheimer's disease. Although there is methodological variability across studies, comparable characteristics of subtypes are reported at the group level. In this study, we investigated whether group-level similarities translate to individual-level agreement across subtyping methods, in a head-to-head context. We compared five previously published subtyping methods. Firstly, we validated the subtyping methods in 89 amyloid-beta positive Alzheimer's disease dementia patients (reference group: 70 amyloid-beta negative healthy individuals) using structural magnetic resonance imaging. Secondly, we extended and applied the subtyping methods to 53 amyloid-beta positive prodromal Alzheimer's disease and 30 amyloid-beta positive Alzheimer's disease dementia patients (reference group: 200 amyloid-beta negative healthy individuals) using structural magnetic resonance imaging and tau positron emission tomography. Subtyping methods were implemented as outlined in each original study. Group-level and individual-level comparisons across methods were performed. Each individual subtyping method was replicated, and the proof-of-concept was established. At the group level, all methods captured subtypes with similar patterns of demographic and clinical characteristics, and with similar cortical thinning and tau positron emission tomography uptake patterns. However, at the individual level, large disagreements were found in subtype assignments. Although characteristics of subtypes are comparable at the group level, there is a large disagreement at the individual level across subtyping methods. Therefore, there is an urgent need for consensus and harmonization across subtyping methods. We call for the establishment of an open benchmarking framework to overcome this problem.