Covid-MANet: Multi-task attention network for explainable diagnosis and severity assessment of COVID-19 from CXR

Ajay Sharma1, Pramod Kumar Mishra1

  • 1Department of Computer Science, Institute of Science, Banaras Hindu University, Varanasi 221005, India.

Pattern Recognition
|June 14, 2022
PubMed

Insights

This study introduces Covid-MANet, an explainable AI system for accurate COVID-19 diagnosis and severity assessment using CT scans. It enhances early detection and interpretation, improving patient outcomes.

Area of Science:

  • Medical Imaging
  • Artificial Intelligence
  • Radiology

Background:

  • The COVID-19 pandemic highlighted the need for accurate and rapid diagnostic tools.
  • Deep learning models show promise in COVID-19 detection but often lack interpretability and generalization.
  • Radiological imaging (CT, CXR) aids in reducing false negatives from RT-PCR tests.

Purpose of the Study:

  • To develop an explainable deep learning system, Covid-MANet, for COVID-19 detection and infection quantification.
  • To improve the generalization and interpretability of AI models for COVID-19 diagnosis.
  • To classify COVID-19 severity using the RALE scoring system.

Main Methods:

  • Developed Covid-MANet, an end-to-end multi-task attention network with three stages: lung localization, multi-class classification (COVID-19, bacterial pneumonia, viral pneumonia, normal, tuberculosis), and infection quantification.
  • Employed a multi-scale attention DenseNet201 (MA-DenseNet201) for classification and UNet with DenseNet121 encoder for infection segmentation.
  • Conducted experiments to enhance model interpretability and explainability, including segmentation-based cropping.

Main Results:

  • The MA-DenseNet201 model achieved 97.75% COVID-19 sensitivity and 96% interpretation with segmentation-based cropping.
  • The UNet with DenseNet121 encoder achieved an 86.15% Dice score for COVID-19 infection segmentation.
  • The Covid-MANet ensemble (MA-DenseNet201, ResNet50, MobileNet) demonstrated 95.05% accuracy and 98.75% COVID-19 sensitivity, validated externally with 98.17% sensitivity.

Conclusions:

  • Covid-MANet provides an interpretable and accurate AI solution for COVID-19 diagnosis, infection quantification, and severity assessment.
  • The proposed model addresses limitations of previous deep learning approaches by offering enhanced generalization and explainability.
  • The system's ability to highlight infected regions supports clinical decision-making and improves diagnostic confidence.

Related Concept Videos

Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT01:25

Imaging Studies for Cardiovascular System VI: Calcium -Scoring CT

Calcium-Scoring CT ScanA calcium-scoring CT scan, also known as coronary artery calcium (CAC) scan, detects calcium deposits in the coronary arteries. This test assesses the risk of coronary artery disease (CAD), which can lead to cardiovascular events such as angina, heart failure, and sudden cardiac arrest.A calcium-scoring CT scan is generally recommended for individuals at intermediate risk of CAD without symptoms. It includes:Men aged 40-75 and women aged 50-75: Especially those with a...
116
Imaging Studies for Cardiovascular System V: CT01:28

Imaging Studies for Cardiovascular System V: CT

Cardiac computed tomography (CT) scanning is an advanced cardiac imaging technique that utilizes CT technology, with or without intravenous (IV) contrast, to produce accurate cross-sectional virtual slices of specific areas of the heart, coronary circulation, and major blood vessels such as the aorta, pulmonary veins, and arteries. The computer processes these slices to generate three-dimensional images. Multidetector CT (MDCT) is a rapid form of CT scanning that captures multiple slices...
66
Chronic Obstructive Pulmonary Disease-IV: Assessement and Diagnostic Studies01:27

Chronic Obstructive Pulmonary Disease-IV: Assessement and Diagnostic Studies

Assessing and diagnosing Chronic Obstructive Pulmonary Disease (COPD) involves a detailed approach that includes a comprehensive review of medical history, physical examination, and a variety of diagnostic tests. This thorough evaluation is essential to ensure an accurate diagnosis and guide effective management strategies.
Medical History
2.6K
Computed Tomography01:10

Computed Tomography

Tomography refers to imaging by sections. Computed tomography (CT) is a non-invasive imaging technique that uses computers to analyze several cross-sectional X-rays to reveal minute details about structures in the body.
The technique was invented in the 1970s and is based on the principle that as X-rays pass through the body, they are absorbed or reflected at different levels. In the technique, a patient lies on a motorized platform while a computerized axial tomography (CAT) scanner rotates...
6.1K