GAM-SpCaNet: Gradient awareness minimization-based spinal convolution attention network for brain tumor...

Brain tumor is one of the common diseases of the central nervous system, with high morbidity and mortality. Due to the wide range of brain tumor types and pathological types, the same type is divided into different subgrades. The imaging manifestations are complex, making clinical diagnosis and treatment difficult. In this paper, we construct SpCaNet (Spinal Convolution Attention Network) to effectively utilize the pathological features of brain tumors, consisting of a Positional Attention (PA) convolution block, Relative self-attention transformer block, and Intermittent fully connected (IFC) layer. Our method is more lightweight and efficient in recognition of brain tumors. Compared with the SOTA model, the number of parameters is reduced by more than three times. In addition, we propose the gradient awareness minimization (GAM) algorithm to solve the problem of insufficient generalization ability of the traditional Stochastic Gradient Descent (SGD) method and use it to train the SpCaNet model. Compared with SGD, GAM achieves better classification performance. According to the experimental results, our method has achieved the highest accuracy of 99.28%, and the proposed method performs well in classifying brain tumors.