A Novel Channel-Spatial Deep Residual Attention Network for the Classification of Neurodegenerative Diseases from MRI Scans
Abstract
Personalized and precise classification of neurodegenerative diseases (Alzheimer’s and brain tumors) is crucial for early diagnosis and patient care. Brain tumors and Alzheimer’s disease are challenging to classify due to their varied shapes and features. In this work, we propose a novel four-block residual attention model for the classification of brain lesions and Alzheimer’s disease in magnetic resonance imaging (MRI). The 4-block attention model integrates a channel attention module (CAMB) and a spatial attention module (SAMB) into each of its four blocks. We also implemented the Residual Attention Network (RAN) to improve overall disease information further and achieve better classification and generalization. An ablation study was conducted to determine the optimal number of blocks, testing RAN models with 2, 3, 4, and 5 blocks for training and validation. The proposed 4-block RAN model achieved an accuracy of 96.8% on the Alzheimer dataset and 98.5% on the Figshare Brain dataset. With only 115 layers and 6.3 million parameters, the proposed model is significantly more compact than state-of-the-art architectures while maintaining improved classification performance for brain lesions and Alzheimer’s disease from MRI Scans.
Similar content being viewed by others
Introduction
Medical concerns are among the most pressing global challenges, driving continuous efforts by clinicians and researchers to improve diagnostic accuracy, treatment strategies, and patient outcomes [1]. The human nervous system is a highly complex and essential system that regulates cognitive, sensory, and physiological functions. Due to its structural and functional complexity, it is particularly vulnerable to a wide range of disorders that can severely impair quality of life. Among neurological disorders, neurodegenerative diseases and brain tumors represent two major and distinct categories with significant clinical and societal impact [2].
Neurodegenerative diseases affecting this system constitute a major global health challenge, among which Alzheimer’s disease (AD) is the most prevalent. AD accounts for approximately 70% of all dementia cases [3]. AD is a neurodegenerative disorder characterized by β-amyloid-containing plaques and tau-containing neurofibrillary tangles. This disease causes cognitive impairment acquired in midlife and late life, but the presence of other neurodegenerative and cerebrovascular conditions influences its clinical impact. Despite remarkable advances in medicine, there is currently no treatment capable of stopping or slowing the progression of Alzheimer’s disease [4]. Current research is focused on understanding how this disease alters the brain. The current diagnostic options remain limited to an expensive PET scan or an invasive lumbar puncture [5].
In parallel, brain tumors represent a critical oncological challenge with high morbidity and mortality rates. The World Health Organization (WHO) states that there are around 47 million dementia patients worldwide, and that figure is rising quickly each year; by 2030, there may be 82 million cases of dementia [6]. Around 29,000 instances of brain tumors are detected in the USA each year, and about 13,000 sufferers pass away, according to research from the National Brain Tumor (NBT) Foundation [7]. Furthermore, according to the latest Global Cancer Observatory (GLOBOCAN) 2022 estimates, brain and central nervous system (CNS) cancers continue to represent a significant global health burden. In 2022, brain and CNS cancers accounted for approximately 1.7% of all new cancer cases, making them the 19th most common malignancy and the 12th leading cause of cancer-related mortality worldwide.
Among primary brain tumors, gliomas, which arise from glial cells and include highly aggressive subtypes such as glioblastoma, are among the most common and clinically challenging, particularly due to their infiltrative nature and poor prognosis. Meningiomas, originating from the meninges, are often the most frequently diagnosed benign brain tumors. In contrast, pituitary tumors (adenomas), though generally non-malignant, can cause significant endocrine dysfunction and mass effect symptoms [8]. Alzheimer’s disease and brain tumors are two of the most important neurological diseases in the world, with a growing incidence. The World Health Organization estimates that there were around 57 million people with dementia globally in 2021, and that almost 10 million new cases are diagnosed annually. The most prevalent type of dementia is Alzheimer’s disease, which is responsible for about 60–70% of dementia cases [9].
Therefore, early and accurate tumor identification is crucial for treatment planning and prognosis, yet it remains a complex task due to tumor heterogeneity and overlapping radiological characteristics. With so many patients worldwide, a variety of medical imaging methods are employed for diagnosis, including computed tomography (CT), PET (positron emission tomography), MRI (magnetic resonance imaging), and X-rays. MRI is a widely used neuroimaging technique that allows noninvasive visualization of the inside of the body [10, 11]. Researchers typically use MRI methods to identify and examine the brain [12]. This manual procedure is error-prone, laborious, and time-consuming. Moreover, delays could occur because radiologists are not always available. The limitations mentioned have driven the creation of computer-aided diagnosis (CAD) systems, designed to help clinicians enhance diagnostic accuracy, consistency, and efficiency [13, 14].
Early detection of diseases is now possible through machine learning (ML) and deep learning (DL) techniques, driven by advancements in computer technology and the availability of open-access neuro-related datasets [15, 16]. Deep neural networks have demonstrated high accuracy in detecting subtle and complex alterations in brain structure, tracking injury progression, and providing reliable results for determining the underlying cause of a condition [17]. Research has also shown that deep learning models can be effectively applied to medical imaging for the diagnosis of both viral and non-viral diseases, such as brain tumors, Alzheimer’s, and others [18,19,20]. In this work, we addressed the above challenges and proposed a novel deep learning framework for classifying Alzheimer’s disease and other brain-related diseases from MRI scans. The key contribution of the proposed model is as follows:
-
An integrated classification system for multiple neurodegenerative diseases, such as brain tumors and Alzheimer’s. Most previous studies focused either on tumors or on degenerative disease. Our research developed a comprehensive classification system for both brain tumors and Alzheimer’s disease using MRI data.
-
We present an innovative four-block attention model for accurate classification of brain lesions and tumors. The 4-block attention model combines the CAMB and SAMB layering structure used in each of its four blocks.
-
The proposed four-block model provides an equivalent or superior level of accuracy with fewer layers (115), fewer parameters (6.3 M), and a total model size smaller than any other model at 22.17 MB.
-
Our hybrid deep feature extraction and Neural Network-Based Classification strategy achieves the highest combined clinical accuracy on a large dataset of brain MRIs compared to previous studies.
Related Work
Deep learning has been widely used to develop automatic, semiautomatic, and hybrid models capable of accurately detecting and classifying tumors [21,22,23]. Inspired by the neural networks of the human brain, such models are typically represented as a sequence of layers, each of which is generated by a weighted sum of information from the previous layer. The first layer represents the input data, while the final layer represents the output. Multilayer architectures allow these models to tackle extremely complex problems while often requiring less human intervention than conventional machine learning techniques [24, 25].
Arumaiththurai et al. [26] introduced two methods for classifying brain tumors using deep learning and machine learning techniques. The first uses decision trees and SVM, while the second uses CNNs such as VGG19 and ResNet152. The Figshare brain tumor dataset was used to assess their effectiveness. The CNN-based method achieved an accuracy of 94.67%. Therefore, only 80.54% was achieved using the method based on statistical characteristics and an SVM classifier. Compared to other methods, the CNN-based approach performs better in classification. Abhilasha et al. [27] presented an AlexNet-based architecture that can be trained in less than an hour and produces results comparable to those for classifying pituitary tumors, gliomas, and meningiomas. They achieved 96.38% accuracy on the test dataset after training their model on the publicly accessible “Figshare” dataset. Singh et al. [28] demonstrated that brain tumor diagnosis was challenging due to the variability and overlap in MRI images. They designed a hybrid CNN model that employs CNNs, Support Vector Machines, Random Forests, and Multinomial Logistic Regression. The ensemble learning method achieves 96.08% accuracy and shows promising results on the Figshare dataset.
Recently, Aluri et al. [29] developed a new approach that combines SegNet and GTLO-LeNet to accurately classify brain tumors into Gliomas, Meningiomas, and Pituitary tumors. The non-local means (NLM) filter was used to preprocess the input MRI image, denoising it. The SegNet model segmented the tumor area from the MRI image to achieve effective classification. In contrast, the LeNet model performed brain tumor classification (BTC) by optimizing its weights using the Golden Teacher Learning Optimization Algorithm (GTLO). The experimental results show that the GTLO-LeNet obtained an accuracy of 89.6%. Similarly, Mulla et al. [30] used a VGG-16 CNN architecture to classify three brain tumor classes: meningioma, glioma, and pituitary, and achieved 97.15% accuracy on the test dataset. Balasubramanian et al. [31] introduced a hybrid model for brain tumor detection using MRI. The model combines deep residual networks and Shepherd convolutional neural networks. An accuracy of 94% was achieved by incorporating Adaptive Wiener filtering and Conditional Random Fields–Recurrent Neural Networks (CRF-RNN). Another study by Ajagbe et al. [32] aimed to improve the classification of Alzheimer’s disease (AD) images using deep convolutional neural networks (DCNNs) and transfer learning techniques, while also expanding the evaluation metrics, as the limitations and capabilities of algorithms cannot be adequately captured by a small number of metrics.
The outcomes of their study were evaluated using six metrics, including accuracy, precision, recall, F1-score, computational time, and area under the curve. The CNN achieved the best in two categories, VGG-19 in three, and VGG-16 in one. Overall, the models reached accuracy values between 71.02% and 77.64%.
Yildirim et al. [33] employed a modified ResNet50 model to determine whether a subject had Alzheimer’s disease and the disease stage. Based on disease progression, cases were categorized into four stages. The proposed ResNet50-based model achieved an accuracy of 90%. Chaithra et al. [34] demonstrated that Alzheimer’s disease (AD) can be identified from MRI data and that disease stage can be classified using deep learning algorithms. The authors developed CNN architectures based on transfer learning for AD classification and prediction. The Kaggle AD dataset was used to train DenseNet121, MobileNet, InceptionV3, and Xception models. To ensure a fair comparison, all models were trained on the same dataset. Among them, DenseNet121 achieved the highest performance, with an accuracy of 91% on the test set. Khasanah et al. [35] used an Alzheimer’s MRI dataset to analyze the effect of class imbalance on the accuracy of the k-nearest neighbors (K-NN) method. The dataset, categorized into four groups, was used for training and testing classifications. Cross-validation analysis revealed modest performance, with accuracy values ranging from 45.86% to 50.47%. Priyatama et al. [36] focused on applying machine learning to diagnose Alzheimer’s disease using MRI data. Their approach aimed to support clinical decision-making and streamline the diagnostic process. The authors employed convolutional neural networks (CNNs) with transfer learning (VGG16 and VGG19) for Alzheimer’s disease image classification. The algorithm accuracies were 75.01% for the CNN, 80.10% for VGG16, and 80.28% for VGG19. The mentioned techniques focused on either brain tumors or Alzheimer’s disease. However, it is important to design a model that works for both diseases, with improved accuracy and precision. In addition, the mentioned techniques focused on pre-trained models, traditional machine learning, and transfer learning. In this work, we proposed a novel attention-based deep learning architecture for classifying brain tumors and Alzheimer’s disease from MRI scans.
Materials and methods
This section describes the proposed architecture for classifying brain tumors and Alzheimer’s disease from MRI scans. Two datasets, such as the Figshare Brain and Alzheimer’s MRI datasets, are selected for evaluating the proposed model. The datasets are split at a 70:30 ratio for evaluation, and augmentation is performed afterward. The purpose of augmentation was to increase diversity and balance the number of classes for better learning by the designed model. After that, the training set was passed to the proposed 4-block RAN architecture and trained using optimized hyperparameters. The trained model is used in the testing phase to obtain classification results and predicted labels. Figure 1 illustrates the framework of the proposed 4-block RAN model for neurodegenerative disease classification.
Dataset Description
Figshare Brain Dataset
Figshare Brain Dataset: a publicly available dataset. The database includes 3064 T1-CE MR images from 233 people, representing three common types of brain tumors: pituitary (930 images), meningioma (708 images), and glioma (1426 images). These images were taken between 2005 and 2010 at Nanfang Hospital in Guangzhou, China, and Tianjin Medical University Hospital in China. Each image was obtained in three different planes: coronal (1045 images), axial (994 images), and sagittal (1025 images). The original images were gathered at 512 × 512 pixels and subsequently downsized to 224 × 224 pixels, the size supported by the transfer neural network. 70% of the available data was utilized for training and 30% for testing [37] Fig. 2.
Alzheimer’s Disease MRI Dataset
A collection of 6400 MR images representing four classes—mildly demented (MID), moderately demented (MOD), non-demented (ND), and very mildly demented (VMD)—was gathered from the open-source website Kaggle. The images in the collection are 176 × 208. The images are now 176 by 176 in size [38]. Figure 3 displayed representative images from each of the four classes of this dataset. Figures 2 and 3 show the overall training and test images for both datasets.
Data Preprocessing
To train DL models efficiently, large quantities of high-quality data are required. The restricted availability of necessary data is a significant challenge for medical data analysis. The dataset used in this research is insufficient to achieve the required level of accuracy due to the problem’s highly imbalanced nature. Therefore, data augmentation is applied only to training samples to increase diversity and reduce class imbalance by generating additional samples for minority classes. Using this process, the original image is rotated, flipped, zoomed in, cropped, and translated to create a new image that is an identical image from multiple viewpoints [39]. After data augmentation, the images of both datasets were resized to \(\:227\times\:227\) pixels. The distribution of data per class is shown in Fig. 4.
The Proposed RAN Model
The model starts by taking input images of size 227 × 227, followed by a convolution layer with a depth of 32, a filter size of 3 × 3, and a stride of 2. After this, we have created a residual block consisting of a convolutional layer with depth size 64, filter size 3 × 3, and stride 1, followed by a RELU activation and a batch normalization layer. This pattern is repeated in the residual block, with a depth of 32, a stride of 1, and a filter size of 3 × 3. After that, an additional layer is added, which ends the residual block and acts as the start of the channel attention module block (CAMB) [40]. CAM improves a network’s learning capability with a small increase in computational power and decreases the number of parameters. The focus of the CAM module in this network is on extracting average and salient features of MRI scans along the channel dimension. Mathematically, the CAM block is defined as follows:
Consider the input convolutional layer feature map\(\:{\:F\mathbb{\:}\in\:\mathbb{\:}\mathbb{R}}^{H\times\:W\times\:C}\), where \(\:H\times\:W\) denotes the spatial dimensions of features from the convolutional layer, and \(\:C\) denotes the number of channels. Equations (1–2) represent the formulation of this module.
Where \(\:{\phi\:}_{C}\left(F\right)\) denotes the feature vector after the attention operation in the channel dimension, \(\:AP\) denotes the global average pool operation, \(\:MP\) denotes the global max pool operation, \(\:MLP\) denotes the multilayer perceptron that contains two fully connected layers, and \(\:{\psi\:}^{{\prime\:}}{\in\:\mathbb{R}}^{N\times\:C}\) represents the output of this module.
The CAMB starts with the global average and global max pooling layers added in parallel. Fully connected layers with 64 filters follow both of these layers. After that, a RELU activation layer is added, followed by another fully connected layer with 32 filters. Both these parallel layers are then concatenated using an addition layer. This combination of GAP and GMP, along with the fully connected layer, is also known as a shared MLP. Followed by the addition are the sigmoid function and resize-scale, with the scale set to 114 × 114. After that, a multiplication concatenation is used to combine the addition layer at the start of CAMB with the output of the resize-scale layer.
The concatenation of an avgpool layer and a maxpool layer initiates a Spatial Attention Module Block (SAMB) [40]. The SAM module is focused on ‘where’ in the MRI scans, an informative part complementary to channel attention. The convolutional layer is applied on the concatenated feature map of the previous layer (CAM) to generate SAM \(\:{M}_{S}\left(F\right)\in\:{\mathbb{R}}^{N\times\:C}\). Equations (3–4) represent the formulation of this module.
Where the sigmoid function is represented by \(\:\sigma\:\), and \(\:{h}^{7\times\:7}\) is a convolutional operation of filter size \(\:7\times\:7\). In the proposed architecture, the SAM is followed by a convolutional layer with a filter size of 7 × 7 and a depth value of 32. A sigmoid function follows as an activation function. The multiplication concatenation is used to combine the CAMB output with the sigmoid output in SAMB. After that, an additional layer is inserted that concatenates the output of SAMB with the output of the convolution layer preceding the start of the residual block.
The next RAN block starts with a convolution layer with 128 depth, a 3 × 3 filter, and a stride of 2. After the convolution layer, a residual block is added in the same fashion as in the previous RAN block, changing the convolutional block depth to 96 and 128, respectively, while keeping the filter size 3 × 3 and the stride value 1. CAMB is inserted after the residual block, following the same pattern as in the previous RAN block, with fully connected layers of 96 and 128 filters, respectively. The CAMB ends after the insertion of the sigmoid function and resize-scale, with the scale set to 57 × 57. After that, a multiplication concatenation layer is used to combine the addition layer at the start of CAMB with the resize-scale layer’s output. The output of these layers serves as the starting point for SAMB. An additional layer concatenates the AvgPool and MaxPool layers. It is followed by a convolutional layer with a filter size of 7 × 7 and a depth of 128, followed by a sigmoid function. The multiplication concatenation is used to combine the CAMB output with the sigmoid output in SAMB. After that, an additional layer is added that concatenates the output of SAMB with the output of the convolution layer preceding the start of the residual block.
The third RAN block follows the same pattern as the previous RAN block. It starts with a 256-depth convolutional layer with a 3 × 3 filter and a stride of 2. The residual block is added in the same fashion as in the previous RAN block: after the initial convolution layer, as the start of the third RAN block, with the depth of the convolution layer set to 128 and 256, respectively, while keeping the same filter size and stride. CAMB is placed after the residual block in the same fashion, with the fully connected layers set to 128 and 256, respectively. The CAMB ends after the insertion of the sigmoid function and resize-scale, with the scale set to 29 × 29. After that, a multiplication concatenation layer is used to combine the addition layer at the start of CAMB with the resize-scale layer’s output. The output of these layers serves as the starting point for SAMB. The avgpool and maxpool layers are concatenated, followed by an addition layer, a 256-depth convolution layer with a 7 × 7 filter size, and a sigmoid function. The multiplication concatenation is used to combine the CAMB output with the sigmoid output in SAMB. After that, an additional layer is added that concatenates the output of SAMB with the output of the convolution layer preceding the start of the residual block.
The last RAN block is designed using a method similar to that of the previous RAN blocks. The Last RAN block is initialized with a 512-depth convolutional layer with a 3 × 3 filter. A stride value of 2, followed by a residual block which consists of two pairs of convolution layers, RELU activation layer, and a batch normalization layer added sequentially, where the depth of the convolution layer is set to 256 and 512, respectively, while keeping the filter size 3 × 3 and the stride value is one. CAMB is placed after the residual block in the same fashion, with the fully connected layers set to 256 and 512, respectively. The CAMB ends after the insertion of the sigmoid function and the resize-scale, with the scale set to 15 × 15. After that, a multiplication concatenation layer is used to combine the addition layer at the start of CAMB with the resize-scale layer’s output. The output of these layers serves as the starting point for SAMB. Avgpool and maxpool layers are concatenated by an addition layer followed by the 512-depth convolution layer with a 7 × 7 filter size, and a sigmoid function. The multiplication concatenation is used to combine the CAMB output with the sigmoid output in SAMB. After that, an additional layer is added that concatenates the output of SAMB with the output of the convolution layer preceding the start of the residual block.
A convolution layer is added after the fourth RAN block, with a depth of 1024, followed by a GELU activation layer, GAP, a fully connected layer, and a softmax layer. The FC layer used the softmax activation function for the final classification. The mathematical formulation of this layer is defined by Eq. (5).
Where \(\:{{\Psi\:}}_{softmax}\) denotes the softmax activation function. The proposed model is trained using the categorical cross-entropy loss function. The mathematical formulation is:
Where \(\:N\) denotes the overall training samples. \(\:K\) denotes the number of classes present in the selected datasets, \(\:{y}_{i}\) is the actual labels of the \(\:{i}^{th}\) sample, \(\:{p}_{i,k}\) denotes the probability of \(\:{I}_{i}\) belonging to the class \(\:k\), and \(\:\theta\:\) denotes the learnable parameters of the proposed model. The detailed architecture of the proposed RAN model is illustrated in Fig. 5.
Hyperparameters Selection
After that, the training of the proposed model on the selected datasets is an important step. During training, several hyperparameters are selected, such as the initial learning rate, momentum, optimizer, epochs, and batch size. In the past, researchers employed manual hyperparameter selection, but this is not a good idea and is always discouraged; it is better to select these using an optimization technique. In this work, we used Bayesian Optimization (BO) [41] to select hyperparameters. Hyperparameter optimization aims to find the global optimal value \(\:{u}^{*}\) of an unknown blackbox model \(\:{\Delta\:}\), whose function \(\:f\left(u\right)\) can be evaluated for any arbitrary \(\:\text{u}\in\:\stackrel{\sim}{\text{U}}\). Hence,
The BO is employed to solve this problem using the objective function, a Gaussian process, and an acquisition function. The Gaussian Process (GP) is based on the mean and standard deviation and defined as follows:
The expected improvement (EI) is employed as an acquisition function in this work, supported by strong theoretical guarantees and empirical effectiveness. EI is defined as follows:
Where \(\:PD\) denotes the posterior distribution for the GP, \(\:E\) denotes the expectation value, and \(\:\mu\:\left(u\right)\) is a mean function. Based on the BO, the best hyperparameters are as follows: initial learning rate of 0.000206, momentum of 0.710, epochs of 30, batch size of 128, and optimizer of ADAM. The trained model is finally employed in the testing phase for the final classification results. The algorithm of the proposed framework is as follows:
Proposed Testing Framework
In this section, the proposed model testing has been discussed. The testing of the proposed 4-block RAN architecture is divided into two phases. In the first phase, Softmax-based classification is performed, and the results are computed. Also, the model interpretability is analyzed through GradCAM visualization. In the second phase, the proposed model is tested on test samples, and deep features are extracted. The extracted features are evaluated using several neural network classifiers. Figure 6 describes the proposed model testing framework. 30% of the initial dataset, set aside for data augmentation testing, was used in this process.
Results and Discussion
Experimental Setup and Evaluation Metrics
Neuroimaging investigations were conducted using the Brain Figshare and Alzheimer datasets. As mentioned above, 70% of the images in each class were used for training, and the remaining 30% for testing, resulting in a 70:30 split of the dataset. A 10-fold cross-validation strategy was used during training and testing. Furthermore, the four-block RAN Network was trained by optimizing various hyperparameters, including the learning rate, number of epochs, momentum, mini-batch size, and optimizer. The hyperparameter settings were selected via Bayesian Optimization, as discussed in the proposed section. The entire experimental process was conducted in MATLAB 2025 b on a personal workstation with a 32GB Graphics card and 128GB of RAM. The performance of the proposed model is tested in the following experiments:
-
A Softmax classifier is applied to evaluate classification performance on the selected datasets.
-
Features classification using neural network classifiers, including narrow, wide, bi-layered, and tri-layered.
-
These classifiers are applied to both datasets separately, and confusion matrices are generated for validation.
-
Detailed ablation studies and comparisons were also conducted with several blocks and state-of-the-art techniques.
Proposed Model Brain Tumor Classification Results
Table 1 presents the classification performance of the proposed model using the augmented brain dataset. The Softmax is the top-performing classifier, with an outstanding 98.5% accuracy. Additionally, this classifier has a 98.5% sensitivity, a 98.36% precision, an AUC of 0.9954, an FPR of 0.007367, an F1 score of 98.432%, and an equivalent FNR of 1.5%. This table shows each classifier’s computing time; the Softmax takes noticeably less time than the others. The other listed classifiers in this table, such as NNN, WNN, BNN, and TNN, achieved accuracies of 97.2%, 98.4%, 97.3%, and 97.4%, respectively. These classifiers also show improved performance on this dataset. According to the test results, the tri-layered neural network has the longest execution time of 13.06 s. Figure 7 depicts the confusion matrix of the Softmax classifier, which can be used to verify the performance of the proposed accuracy, precision, and recall rates. In this figure, part (A) shows the recall rate verification, and part (B) shows the precision for each class. Overall, the proposed model shows improved performance across precision, recall, and accuracy.
Proposed Model Alzheimer’s Disease Classification Results
Table 2 presents the results of the proposed 4-block RAN architecture for the Alzheimer’s disease dataset. This table shows that the Softmax classifier achieved the highest accuracy of 96.8%. The other measures computed for this classifier are recall rate (96.75), precision (96.77), area under the curve (0.9973), FNR (3.25), and F1 score (96.76). The second-best accuracy was achieved by a Wide neural network (WNN) of 94.9%. The remaining classifiers had the best accuracy scores of 92.7%, 93%, and 93.4%, respectively. The confusion matrix of a Softmax classifier, illustrated in Fig. 8, can be used to verify the recall and precision rates obtained. Also, these figures show which class has the highest correct prediction rate, such as Moderate Demented and Mild Demented. Overall, the proposed model shows improved performance on the selected dataset for Alzheimer’s disease classification.
Ablation Studies
Ablation Study 1- Detailed ablation studies are conducted in this section for the proposed 4-block RAN architecture using brain tumor and Alzheimer datasets. In the first part of the ablation study, the proposed RAN architecture is trained with 2, 3, and 5 blocks in the framework, using hyperparameter settings like those used for the 4-block RAN framework (selected via Bayesian Optimization). The epochs are updated to 20, 30, and 40, and results are obtained, as listed in Table 3. In this table, it is observed that with 30 epochs and the Figshare Brain dataset, a 4-block RAN achieved 90% training accuracy. Furthermore, an Alzheimer dataset was used to train these networks, and the 4-block RAN achieved 78.84% training accuracy after 30 epochs. Various RAN network blocks were implemented to test training performance, and it has been shown that, under the same configuration, a RAN with four blocks achieved the best training efficiency among all the blocks listed in this table.
Based on the models’ accuracy, heat maps show the correlation between the models’ performance before and after the selected datasets are augmented. Figure 9 shows the heat map of a 4-block model with epochs ranging from 20 to 40. Lighter hues, such as white and beige, indicate more accuracy, whereas darker hues, such as black, indicate poorer accuracy. This color gradient facilitates the rapid identification of variations in dataset augmentation performances. The distribution and variability of accuracy values across various situations are compared using a box plot, which shows the accuracy of two datasets before and after augmentation. Figure 10 shows a box plot for the 4-block RAN model.
Ablation Study 2 - In the subsequent stage, the suggested models are contrasted with deep state-of-the-art models across fundamental configurations, including the number of layers, model parameters, and model size in megabytes. According to Table 4, DenseNet201 has 77 MB, 20 M parameters, and 708 total layers. Other pre-trained models, such as ResNet101, NasNetLarge, and GoogleNet, have sizes of 167 MB, 332 MB, and 27 MB, 347 MB, 1243 MB, and 144 MB, and 44.6 M, 88.9 M, and 6.9 M parameters, respectively. Our proposed 4-block RAN network has 115 layers, 6.3 million parameters, and a size of 22.17 megabytes. The suggested model has fewer layers than DensNet201, ResNet101, NasNetLarge, and GoogleNet. In addition, the suggested network has fewer parameters than the models mentioned above. The suggested RAN, consisting of four blocks, is the most compact of the models mentioned.
Ablation Study 3- A detailed comparison was made based on the accuracy of the listed models in Fig. 11. The accuracy for the proposed 4-block RAN network was 96.8% on the Alzheimer MRI dataset and 98.5% on the Figshare Brain dataset, indicating strong performance on both datasets. To compare, a few existing deep learning models: GoogleNet achieved 83.0% and 88.9% on Alzheimer MRI and Figshare Brain datasets, respectively, while ResNet101 scored 86.0% and 89.0%, DenseNet201 scored 89.9% and 91.6%, and NasNetLarge scored 92.0% and 93.0%. AE ViT [46] achieved a competitive performance of 94.2%, while the Hybrid Network [47], IRBwSA [16], MultiScale MoE [48], Customized CNN [49], and CNN-SVM [50] achieved performance of 96.01%, 96.1%, 96.92%, 97.84%, and 84.77%, respectively. Overall, the proposed 4-block RAN architecture performed best on the Figshare Brain dataset and showed strong performance on the Alzheimer dataset, demonstrating its efficiency compared with advanced deep learning models.
Ablation study 4- An ablation study was conducted to compare the ablating effects of the Channel Attention Module Block (CAMB) and Spatial Attention Module Block (SAMB) under four different combinations of the proposed RAN architecture, as shown in Table 5. The baseline model without CAMB and SAMB had 94.21% accuracy on the Figshare Brain and Alzheimer datasets, respectively. The accuracy of the baseline model improved to 95.95% and 93.94% with the addition of CAMB to the Figshare and Alzheimer datasets, respectively, with increases of 1.74% and 0.78% on each. This suggests that the MRI feature representation is discriminative for channel-wise feature recalibration. Likewise, SAMB, when used individually, attained accuracies of 96.15% and 94.65% in the Figshare and Alzheimer datasets, respectively. This is an improvement of 1.94% and 1.49% for the two models, respectively, when compared to the baseline model. These findings show that spatial attention outperforms channel attention alone, helping the model focus on MRI regions associated with disease. The proposed complete model, which included both CAMB and SAMB, achieved the best accuracies of 98.53% and 96.80% when tested on the Figshare Brain and Alzheimer datasets, respectively. The complete model achieved 4.32% higher accuracy than the baseline model on the Figshare dataset and 3.64% higher accuracy on the Alzheimer dataset. In the Figshare and Alzheimer datasets, the performance of the complete model was improved by 2.58% and 2.86%, respectively, compared to the CAMB-only model. These gains of 2.38% and 2.15% were obtained when the complete model was compared to the SAMB-only model. The present results validate the complementarity between CAMB and SAMB. CAMB optimizes feature selection in the channel, and SAMB optimizes the spatial localization of the discriminative regions. Combined usage of them gives the best configuration of the proposed RAN architecture for the classification of brain tumors and Alzheimer’s disease.
Proposed Model Interpretability
Lastly, we used visualization techniques such as Grad-CAM and Grad-CAM + + to interpret the proposed 4-block RAN architecture on selected datasets during testing. Figures 12 and 13 show the visual interpretation of the proposed model on a few test images. From these images, it is observed that the proposed model correctly classifies each image into a relevant class and then identifies the important region of interest using the visualization technique. In addition, the Grad-CAM + + technique provides better visualizations than simple Grad-CAM. Overall, the proposed model shows improved precision and interpretability in classifying brain tumors and Alzheimer’s disease from MRI scans.
Overall Findings
After the experimentations on the selected datasets, ablation studies, and model interpretability, we observe the following key findings of this work:
-
Softmax classifier obtained improved performance on the selected datasets using the proposed model for the brain and Alzheimer’s datasets. The other neural network classifiers also performed better, achieving high precision.
-
Several epochs are selected to observe the proposed model’s behavior during training, and we find that epoch 30 yields the best performance.
-
The trainable parameters of the proposed model are fewer than those of the other listed pre-trained models. Although we did not include many pre-trained models, we used the best-performing models for comparison.
-
Clinically, the proposed model is well-suited due to its improved interpretability and low computational requirements.
Real-Time Implication
To illustrate the applicability of the framework, a clinical case study exploring MRI-based decision support is presented, along with a prototype clinical case study. In a real clinical workflow, patients’ MRI scans might be resized, normalized, and converted to channels if they are suspected of having a brain tumor or Alzheimer’s disease. The trained 4-block RAN model can thus recognize the MRI image as a specific disease class. The model makes predictions for glioma, meningioma, or pituitary tumor for brain tumor and for non-demented, very mild demented, mild demented, or moderate demented classes on the Alzheimer MRI. The proposed system could serve as a second opinion tool to assist radiologists. In addition to the predicted class and confidence score, Grad-CAM and Grad-CAM + + visualizations can identify the image regions that most influenced the prediction. If the model output matches the radiologist’s interpretation, it could enhance diagnostic confidence. Disagreements may be referred to another expert for review. The model is suitable for prototype integration into a lightweight clinical decision-support system, as it contains 6.3 million parameters and occupies 22.17 MB.
Conclusion
In this paper, a novel deep learning residual attention architecture is proposed for the classification of neurodegenerative diseases from MRI scans. The proposed architecture is called a 4-block RAN model that integrates CAMB and SAMB layering structures within a single framework. In the proposed model, the overall RAN architecture improved the model interpretability and generalizability. The proposed architecture is trained with hyperparameters optimized using Bayesian Optimization (BO), rather than manual selection. The experimental process was conducted on two MRI datasets, such as brain tumor MRI Scans and Alzheimer’s disease. On these datasets, the proposed model obtained improved performance of 96.8% and 98.5%, respectively. Based on detailed ablation studies, comparative analysis, and interpretation of results, we conclude that the proposed 4-block RAN architecture shows improved performance in terms of precision rate and accuracy. In addition, the proposed model contains fewer learning parameters, such as 6.3 million, which are better than the other listed pre-trained models. Due to fewer learning parameters, improved precision, and better interpretability, the proposed model is more suitable for clinical practice in analyzing brain tumors and Alzheimer’s disease from MRI Scans. In the future, the attention blocks will be replaced with a state-space module, and the model will be evaluated on additional MRI datasets.
Data Availability
The datasets used in this work are publically available for research purposes and properly cited in the main manuscript.
References
Talukder MA, et al. An efficient deep learning model to categorize brain tumor using reconstruction and fine-tuning. Expert Syst Appl. 2023;230:120534.
Mohsen S, Yousef A, Abdel-Aziz M. A Hybrid of ResNext101_32x8d and Swin Transformer Networks with XAI for Alzheimer’s Disease Detection. Computers. 2026;15(2):95.
Alsalem K, Elbashir MK, Alzahrani AO, Mohammed M, Mahmood MA. and T. Abd El Fattah, Progression-Aware and Explainable CNN–Transformer Framework for Multiclass Alzheimer’s Disease Staging Using MRI, Diagnostics. 2026.
Rauf F, et al. DenseIncepS115: a novel network-level fusion framework for Alzheimer’s disease prediction using MRI images. Front Oncol. 2024;14:1501742.
Reyes D, Sánchez J. Performance of convolutional neural networks for the classification of brain tumors using magnetic resonance imaging. Heliyon. 2024;10(3).
Mohammed BA, Senan EM, Rassem TH, Makbol NM, Alanazi AA, Al-Mekhlafi ZG, Ghaleb FA. Multi-method analysis of medical records and MRI images for early diagnosis of dementia and Alzheimer’s disease based on deep learning and hybrid methods. Electronics. 2021;10(22):2860.
Nawaz M, Nazir T, Masood M, Mehmood A, Mahum R, Khan MA, Kadry S, Thinnukool O. Analysis of brain MRI images using improved cornernet approach. Diagnostics. 2021;11(10):1856.
Salles D, Santino SF, Malinverni AC, Stavale JN. Meningiomas: a review of general, histopathological, clinical and molecular characteristics. Pathology-Research Pract. 2021;223:153476.
Topannavar PS, Yadav DM, Bendre V. Global Self-Attention Module Based Convolutional Neural Network for Brain Tumor Classification. Int J Intell Eng Syst. 2024;17(3):647.
Tummala S, Kadry S, Bukhari SAC, Rauf HT. Classification of brain tumor from magnetic resonance imaging using vision transformers ensembling. Curr Oncol. 2022;29(10):7498–511.
Abbas MJ, Khan MA, Hussain A, Ayouni S, Maddeh M, Alhayan F. XRDNet: a Novel Explainable Residual Dense Fusion Network for Alzheimer’s Disease Recognition from MRI Images. Cogn Comput. 2025;17(6):174.
Ullah N, Khan JA, Khan MS, Khan W, Hassan I, Obayya M, Negm N, Salama AS. An effective approach to detect and identify brain tumors using transfer learning. Appl Sci. 2022;12(11):5645.
Liao Q-M, et al. Computer-Aided Application in Medicine and Biomedicine. Int J Comput Intell Syst. 2025;18(1):221.
Asif S, et al. FHD-HybridNet: A fuzzy hellinger distance-guided hybrid deep learning framework for robust multiclass brain tumor classification. Biomed Signal Process Control. 2026;113:108927.
Fathi S, Ahmadi A, Dehnad A, Almasi-Dooghaee M, Sadegh M, Alzheimer’s Disease Neuroimaging Initiative. A deep learning-based ensemble method for early diagnosis of Alzheimer’s disease using MRI images. Neuroinformatics. 2024;22(1):89–105.
Ibrar W, et al. A novel interpreted deep network for Alzheimer’s disease prediction based on inverted self attention and vision transformer. Sci Rep. 2025;15(1):29974.
Yu M et al. Alzheimer’s disease brain image segmentation using multi-feature fusion in 3D Rényi entropy model and quantum hybrid optimization. Artif Intell Rev. 2026.
Ramya M, Kavitha A. Mamdani fuzzy inference system based on multi-textural biomarkers for Alzheimer’s stage detection. Comput Methods Biomech Biomedical Engineering: Imaging Visualization. 2026;14(1):2439278.
Neffati S, Mekki K, Machhout M. Deep learning-based CAD system for Alzheimer’s diagnosis using deep downsized KPLS. Sci Rep. 2025;15(1):18556.
Mushtaq M, Khan MA, Hussain Z, Ayouni S, Maddeh M, Alhayan F. A Network-Level fused DenseInc226 lightweight architecture for alzheimer’s disease prediction from magnetic resonance imaging. Cogn Comput. 2025;17(6):1–25.
Das S, Goswami RS. Advancements in brain tumor analysis: a comprehensive review of machine learning, hybrid deep learning, and transfer learning approaches for MRI-based classification and segmentation. Multimedia Tools Appl. 2025;84(23):26645–82.
Bouhafra S, El Bahi H. Deep learning approaches for brain tumor detection and classification using MRI images (2020 to 2024): A systematic review. J Imaging Inf Med. 2025;38(3):1403–33.
Yang J et al. Braincnn: Automated brain tumor grading from magnetic resonance images using a convolutional neural network-based customized model. SLAS Technol. 2025;100334.
Pusparani Y, Lin CY, Jan YK, Liau BY, Lin FY, Furqon EN, Talal M, Pravin SC, Tsai ZR, Lung CW. Evaluation of deep learning models for segmentation of hippocampus volumes from MRI images in Alzheimer’s disease. Sci Rep. 2026;16(1):7878.
Alsubai S, et al. Transfer deep learning and explainable AI framework for brain tumor and Alzheimer’s detection across multiple datasets. Front Med. 2025;12:1618550.
Arumaiththurai T, Mayurathan B. The Effect of Deep Learning and Machine Learning Approaches for Brain Tumor Recognition, in 2021 10th International Conference on Information and Automation for Sustainability (ICIAfS), 2021: IEEE, pp. 185–190.
Abhilasha K, Swati S, Kumar M. Brain tumor classification using modified AlexNet network, in Advances in Distributed Computing and Machine Learning: Proceedings of ICADCML 2022: Springer. 2022;425–433.
Singh I, Yadav RK, Virahaniya R, Alam N. Ensemble of hybrid CNN models for brain tumor classification, in 2022 2nd International Conference on Intelligent Technologies (CONIT). 2022;IEEE:1–7.
Aluri S, Imambi SS. Brain tumour classification using MRI images based on lenet with golden teacher learning optimization. Network: Comput Neural Syst. 2024;35(1):27–54.
Mulla M, Direkoğlu C. Brain tumor classification using a convolutional neural network and different optimizers, in 2023 Innovations in Intelligent Systems and Applications Conference (ASYU), 2023;IEEE:pp. 1–6.
Balasubramanian S, Mandala J, Rao TVM, Misra AJBSP. RF-ShCNN: A combination of two deep models for tumor detection in brain using MRI. Control. 2024;88:105656.
Ajagbe SA, Amuda KA, Oladipupo MA, AFE OF, Okesola KI. Multi-classification of Alzheimer disease on magnetic resonance images (MRI) using deep convolutional neural network (DCNN) approaches. Int J Adv Comput Res. 2021;11(53):51.
Yildirim M, Cinar A. Classification of Alzheimer''s disease MRI images with CNN based hybrid method. Ingénierie des Systèmes d Inf. 2020;25(4):413–8.
Chaihtra D, Shetty SV. Alzheimer’s disease detection from brain MRI data using deep learning techniques, in 2021 2nd Global Conference for Advancement in Technology (GCAT), 2021: IEEE, pp. 1–5.
Khasanah I. Enhancing Alzheimer''s Disease Diagnosis with K-NN: A Study on Pre-processed MRI Data. Int J Artif Intell Med Issues. 2024;2(1):49–60.
Priyatama A, Sari Z, Azhar Y. Deep learning implementation using convolutional neural network for alzheimer’s classification. Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi). 2023;7(2):310–217.
Polat Ö, Güngen C. Classification of brain tumors from MR images using deep transfer learning: O. Polat, C. Güngen. J Supercomput. 2021;77(7):7236–52.
Murugan S, Venkatesan C, Sumithra MG, Gao XZ, Elakkiya B, Akila M, Manoharan S. DEMNET: a deep learning model for early diagnosis of Alzheimer diseases and dementia from MR images. Ieee Access. 2021;9:90319–29.
Cinar N, Kaya M, Kaya B. A novel convolutional neural network‐based approach for brain tumor classification using magnetic resonance images. Int J Imaging Syst Technol. 2023;33(3):895–908.
Woo S, Park J, Lee J-Y, Kweon IS. Cbam: Convolutional block attention module, in Proceedings of the European conference on computer vision (ECCV), 2018;pp. 3–19.
Wu J, Chen X-Y, Zhang H, Xiong L-D, Lei H, Deng S-H. Hyperparameter optimization for machine learning models based on Bayesian optimization. J Electron Sci Technol. 2019;17(1):26–40.
Huang G, Liu Z, Van Der Maaten L, Weinberger KQ. Densely connected convolutional networks, in Proceedings of the IEEE conference on computer vision and pattern recognition. 2017;pp. 4700–4708.
He K, Zhang X, Ren S, Sun J. Deep residual learning for image recognition, in Proceedings of the IEEE conference on computer vision and pattern recognition. 2016;770–778.
Zoph B, Vasudevan V, Shlens J, Le QV. Learning transferable architectures for scalable image recognition, in Proceedings of the IEEE conference on computer vision and pattern recognition. 2018;8697–8710.
Szegedy C et al. Going deeper with convolutions, in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015;pp. 1–9.
Navin AH, Shamsi M. Regional attention-enhanced vision transformer for accurate Alzheimer’s disease classification using sMRI data. Comput Biol Med. 2025;197:111065.
Ilani MA, Shi D, Banad YM. T1-weighted MRI-based brain tumor classification using hybrid deep learning models. Sci Rep. 2025;15(1):7010.
Hamza A, Damaševičius R. Multiscale MoE: A Mixture of Experts Framework with Attention-Driven Multi-Scale Learning for Brain Tumor Classification, in 2025 20th Conference on Computer Science and Intelligence Systems (FedCSIS), 2025: IEEE, pp. 3–12.
Raza N, Naseer A, Tamoor M, Zafar K. Alzheimer disease classification through transfer learning approach. Diagnostics. 2023;13(4):801.
Semwal T, Jain S, Mohanta A, Jain A. A hybrid CNN-SVM model optimized with PSO for accurate and noninvasive brain tumor classification. Neural Comput Appl. 2025;37(33):27901–30.
Funding
Authors like to thanks Princess Nourah bint Abdulrahman University Researchers Supporting Project number (PNURSP2026R349), Princess Nourah bint Abdulrahman University, Riyadh, Saudi Arabia. This work was supported by Institute of Information & communications Technology Planning & Evaluation (IITP) under the artificial intelligence star fellowship support program to nurture the best talents (IITP-2026-RS-2026-25617111) grant funded by the Korea government (MSIT). This work was supported by the National Research Foundation of Korea (NRF) grant funded by the Korea government (MSIT) (No. RS-2023-00218176) and the Soonchunhyang University Research Fund. The authors extend their appreciation to the deanship of research and graduate studies at King Khalid University for funding this work through a large research project under grant number RGP2/603/45.
Author information
Authors and Affiliations
Contributions
Wardah Ibrar, Muhammad Attique Khan, Syeda Aimal Naqvi, Zain Hussain, Latifah Almuqren, Amina Hussain, Mohammad Alhefdi, Yunyoung Nam. All authors contributed equally in this work.
Corresponding author
Ethics declarations
Human Consent
Not Applicable.
Competing interests
The authors declare no competing interests.
Conflict of interest
All authors declared no conflict of interest in this work.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Ibrar, W., Khan, M.A., Naqvi, S.A. et al. A Novel Channel-Spatial Deep Residual Attention Network for the Classification of Neurodegenerative Diseases from MRI Scans. Cogn Comput 18, 106 (2026). https://doi.org/10.1007/s12559-026-10652-0
Received:
Accepted:
Published:
Version of record:
DOI: https://doi.org/10.1007/s12559-026-10652-0
How it works
Once you click Generate, Ollama reads this article and crafts 5 comprehension questions. Your answers are graded against the article content — general knowledge won't be enough. Score 70+ to count toward your certificate.
Questions are cached — you'll always get the same 5 for this article.