Enhancing heart disease prediction using a self-attention-based transformer model

Atta Ur Rahman1,2, Yousef Alsenani3,4, Adeel Zafar5

  • 1Riphah Institute of System Engineering, Riphah International University Islamabad, Islamabad, 46000, Pakistan. atta.rahman@riphah.edu.pk.

Scientific Reports
|January 4, 2024
PubMed

Insights

This study introduces a novel self-attention transformer model for early cardiovascular disease (CVD) risk prediction. The model achieved 96.51% accuracy, outperforming existing methods for heart disease detection.

Area of Science:

  • Artificial Intelligence in Healthcare
  • Machine Learning for Disease Prediction
  • Biomedical Informatics

Background:

  • Cardiovascular diseases (CVDs) are a leading global cause of mortality, necessitating accurate early detection methods.
  • Current diagnostic approaches require timely and precise identification of heart failure risk factors.
  • Automated systems analyzing patient characteristics can aid in early CVD diagnosis.

Purpose of the Study:

  • To develop and evaluate a novel self-attention-based transformer model for predicting cardiovascular disease (CVD) risk.
  • To enhance the accuracy and interpretability of automated heart disease prediction systems.
  • To provide physicians with insights into the features driving model predictions for better clinical understanding.

Main Methods:

  • Deployment of a novel self-attention-based transformer model integrating self-attention mechanisms and transformer networks.
  • Utilizing self-attention layers to capture contextual information and model complex data patterns.
  • Testing the model on the Cleveland dataset from the UCI machine learning repository.

Main Results:

  • The proposed model achieved a highest accuracy of 96.51% on the Cleveland dataset.
  • The model demonstrated superior performance compared to several baseline approaches.
  • Experimental outcomes indicate a higher prediction rate than other state-of-the-art methods for heart disease prediction.

Conclusions:

  • The self-attention-based transformer model offers a highly accurate and interpretable solution for early CVD risk prediction.
  • This approach has the potential to significantly improve clinical trial efficacy and patient therapy.
  • The model's ability to identify key predictive features aids physician comprehension and trust in automated diagnostics.

Related Concept Videos