Accurate classification of glomerular diseases by hyperspectral imaging and transformer

In renal disease research, precise glomerular disease diagnosis is crucial for treatment and prognosis. Currently reliant on invasive biopsies, this method bears risks and pathologist-dependent variability, yielding inconsistent results. There is a pressing need for innovative diagnostic tools that enhance traditional methods, streamline processes, and ensure accurate and consistent disease detection.

In this study, we present an innovative Convolutional Neural Networks-Vision Transformer (CVT) model leveraging Transformer technology to refine glomerular disease diagnosis by fusing spectral and spatial data, surpassing traditional diagnostic limitations. Using interval sampling, preprocessing, and wavelength optimization, we also introduced the Gramian Angular Field (GAF) method for a unified representation of spectral and spatial characteristics.

We captured hyperspectral images ranging from 385.18 nm to 1009.47 nm and employed various methods to extract sample features. Initial models based solely on spectral features achieved a accuracy of 85.24 %. However, the CVT model significantly outperformed these, achieving an average accuracy of 94 %. This demonstrates the model's superior capability in utilizing sample data and learning joint feature representations.

The CVT model not only breaks through the limitations of existing diagnostic techniques but also showcases the vast potential of non-invasive, high-precision diagnostic technology in supporting the classification and prognosis of complex glomerular diseases. This innovative approach could significantly impact future diagnostic strategies in renal disease research.

This study introduces a transformative hyperspectral image classification model leveraging a Transformer to significantly improve glomerular disease diagnosis accuracy by synergizing spectral and spatial data, surpassing conventional methods. Through a rigorous comparative analysis, it was determined that while spectral features alone reached a peak accuracy of 85.24 %, the novel Convolutional Neural Network-Transformer (CVT) model's integration of spatial-spectral features via the Gramian Angular Field (GAF) method markedly enhanced diagnostic precision, achieving an average accuracy of 94 %. This methodological innovation not only overcomes traditional diagnostic limitations but also underscores the potential of non-invasive, high-precision technologies in advancing the classification and prognosis of complex renal diseases, setting a new benchmark in the field.