A Dynamic Fractional Fourier Transformer with Local-Global Spectral Attention for Medical Hyperspectral Image...

Medical hyperspectral images (MHSIs) are highly promising for assisting with pathological diagnoses because of their rich spatial and spectral information. However, the existing methods inadequately model joint spatial-frequency correlations and struggle to dynamically separate nonstationary pathological details from global structures. To address these challenges, a fractional Fourier transformer (FracTrans) that is designed to explicitly model the nonstationary spatial-frequency correlations that are inherent in MHSIs is proposed in this paper. By integrating a learnable fractional Fourier transform (FrFT) into a self-attention mechanism, FracTrans achieves an adaptive spatial-frequency decomposition process that dynamically isolates high-frequency pathological details from low-frequency global trends. Furthermore, FracTrans integrates sliding local-channel spectral attention and global-channel spectral attention to model channelwise spectral dependencies and combines multiscale patch embedding with feature fusion to capture spectral-spatial correlations. To overcome the quadratic computational bottleneck of the standard self-attention mechanism, the FrTrans module incorporates a stochastic frequency-mode sampling mechanism, significantly accelerating the processing of high-dimensional MHSI data. A fivefold cross-validation conducted on multidimensional choledoch and gastric precancerous lesion datasets demonstrates that FracTrans significantly outperforms the mainstream methods. Ablation experiments further confirm that integrating the FrTrans module into the baseline yields a 7.35% accuracy improvement, substantiating its efficacy. Collectively, FracTrans provides an efficient and robust MHSI classification framework, showing broad potential for use in lesion detection and computer-aided diagnosis tasks. The source code is available at https://github.com/chenqikai908-stack/FracTrans.