A multi-branch ConvNeXt-MaxViT fusion transformer model for radiographic knee osteoarthritis severity assessment with
Simran1, Vinay Kukreja1, Shiva Mehta1
1Centre for Research Impact & Outcome, Chitkara University Institute of Engineering and Technology, Chitkara University, Punjab, India.
Context:
Knee Osteoarthritis (KOA) is a progressive degenerative joint disorder and a major cause of disability worldwide. Radiographic grading using the Kellgren-Lawrence (KL) scale remains the standard diagnostic method, but inherent subjectivity and difficulty in detecting subtle structural changes reduce diagnostic reliability. Thus, an automated, robust, and explainable system is clinically essential.
Objective:
This study aims to develop an explainable deep learning model capable of accurately classifying KOA severity (KL-0 to KL-4) by integrating both local and global radiographic features, thereby enhancing transparency for clinical decision support.
Method:
The proposed model introduces a dual-branch fusion architecture combining ConvNeXt-Tiny (Convoluional Neural Network with Next Generation Design) for local feature extraction and MaxViT-Tiny (Multi-Axis Vision Transformer) for global contextual modeling. Mid-level fusion (concatenation + Multi-Layer Perceptron(MLP)) and late fusion (weighted ensemble) are implemented to strengthen discriminative representation. Model performance is evaluated using Accuracy, Precision, Recall, F1-score, Area Under the Curve (AUC), Confusion Matrix, Receiver Operating Characteristics (ROC), and explainability via Gradient-weighted Class Activation Mapping Plus Plus (Grad-CAM++).
Results:
The final late-fusion ensemble achieved 96.2 % accuracy, 95.2 % F1-score, 95.4 % precision, 95.1 % recall, and a macro-AUC of 0.981. Class-wise F1-scores were highest for KL-0 (97.1 %) and KL-4 (97.8 %). Five-fold cross-validation confirmed model stability with CI = 96.2 % ± 0.6 %. Grad-CAM++ correctly localized osteophytes, joint-space narrowing, and sclerosis, strengthening interpretability.
Future Scope:
Future work will integrate multi-modal imaging (X-ray and MRI), incorporate longitudinal progression modeling, and evaluate real-world clinical deployment among radiologists to further improve generalizability, robustness, and practical usability of KOA severity assessment systems.
Related Concept Videos
01:10Computed Tomography
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
01:09Functional Classification of Joints
The functional classification of joints is determined by the amount of mobility between the adjacent bones. Joints are functionally classified as a synarthrosis or immobile joint, an amphiarthrosis or slightly moveable joint, or as a diarthrosis, a freely moveable joint. Fibrous and cartilaginous joints can be functionally classified as either synarthroses or amphiarthroses, whereas all synovial joints are classified as diarthroses.
Synarthrosis
An...
01:27Imaging Studies III: Computed Tomography
01:20Structural Classification of Joints
A fibrous joint is where the adjacent bones are united by fibrous connective...
01:14Imaging Studies I: CT and MRI
Description of the Procedures
Computed Tomography (CT) scan:
Computed Tomography (CT) scans use X-ray technology to generate detailed images of bones, organs, and tissues. During the scan, the patient lies on a moving table...
01:30Radiological Investigation II: MRI and Ventilation Perfusion Scan
Magnetic Resonance Imaging (MRI) and Ventilation Perfusion Scans are two radiological investigations that offer detailed diagnostic images of the body, particularly lung structures.
MRI
MRI uses magnetic fields and radiofrequency signals to distinguish between normal and abnormal tissues. This technology provides a more detailed diagnostic image than CT scans, enabling it to characterize pulmonary nodules, stage bronchogenic carcinoma, and evaluate inflammatory activity in...