A comparative analysis of meta-heuristic optimization algorithms for feature selection on ML-based classification of

Şevket Ay1, Ekin Ekinci1, Zeynep Garip1

  • 1Computer Engineering Department, Faculty of Technology, Sakarya University of Applied Sciences, Sakarya, 54187 Turkey.

The Journal of Supercomputing
|June 12, 2023
PubMed

Insights

This study enhances heart disease and heart failure prediction using meta-heuristic algorithms for feature selection, achieving significantly improved F-scores up to 99.72% with machine learning models.

Area of Science:

  • Cardiovascular Disease Research
  • Machine Learning Applications
  • Computational Intelligence

Background:

  • Accurate prediction of heart disease and heart failure is crucial for timely intervention.
  • Traditional machine learning models often struggle with optimal feature selection, impacting predictive accuracy.
  • Meta-heuristic algorithms offer powerful optimization capabilities for complex datasets.

Purpose of the Study:

  • To develop an enhanced machine learning model for predicting heart disease and heart failure.
  • To investigate the efficacy of meta-heuristic algorithms (CS, FPA, WOA, HHO) for feature selection in cardiovascular datasets.
  • To improve classification accuracy by identifying the most informative feature subsets.

Main Methods:

  • Utilized the Cleveland heart disease and heart failure datasets.
  • Applied Cuckoo Search (CS), Flower Pollination Algorithm (FPA), Whale Optimization Algorithm (WOA), and Harris Hawks Optimization (HHO) for feature selection.
  • Integrated selected features with various machine learning classifiers including K-Nearest Neighbour (KNN), Logistic Regression (LR), Support Vector Machine (SVM), Gaussian Naive Bayes (GNB), and Random Forest (RF).

Main Results:

  • Achieved a heart disease prediction F-score of 99.72% using KNN with FPA-selected features (8 features).
  • Achieved a heart failure prediction F-score of 97.45% using KNN with HHO-selected features (5 features).
  • Demonstrated significant improvements in prediction performance compared to models using original datasets.

Conclusions:

  • Meta-heuristic feature selection substantially enhances the performance of machine learning models for cardiovascular disease prediction.
  • The proposed approach effectively identifies critical features, leading to higher classification accuracy.
  • This study provides a robust framework for improving diagnostic and prognostic models in cardiology.

Related Concept Videos

Heart Failure IV: Classification and Diagnostic Evaluation01:30

Heart Failure IV: Classification and Diagnostic Evaluation

Heart failure can be classified in various ways, with the most common classifications based on physical activity limitations, disease progression, severity, and treatment strategies.The Functional Classification of Heart Failure divides patients into four categories based on physical activity limitation due to symptom burden.Class I: Patients in this class have cardiac disease but no physical activity limitations. Ordinary activities like walking, climbing stairs, or routine tasks do not cause...
21
Comparing the Survival Analysis of Two or More Groups01:20

Comparing the Survival Analysis of Two or More Groups

Survival analysis is a cornerstone of medical research, used to evaluate the time until an event of interest occurs, such as death, disease recurrence, or recovery. Unlike standard statistical methods, survival analysis is particularly adept at handling censored data—instances where the event has not occurred for some participants by the end of the study or remains unobserved. To address these unique challenges, specialized techniques like the Kaplan-Meier estimator, log-rank test, and...
228
Classification of Illness01:17

Classification of Illness

The meaning of illness is individualized to each person who experiences an alteration in health. In contrast, disease is a medical term indicating a pathological change in the structure and function of the body or mind. It is a condition that has specific symptoms and boundaries.
An illness is a response to a disease in which the person's level of functioning is changed compared with a previous level. The general classification of illness includes acute and chronic.
Acute illness is severe...
7.6K
Cardiovascular Drugs: Classification based on Therapeutic Indications01:18

Cardiovascular Drugs: Classification based on Therapeutic Indications

Cardiovascular diseases, encompassing a range of conditions, can significantly affect the heart's operations and the overall circulatory system. These conditions impair the heart's ability to pump blood, leading to a deficit in oxygen supply to crucial organs. Anomalies in the heart's electrical system, known as arrhythmias, can cause heartbeats to accelerate or slow down. Usually, heart rates increase during physical activity and decrease while resting or sleeping. However,...
2.9K
Pharmacokinetic Models: Comparison and Selection Criterion01:26

Pharmacokinetic Models: Comparison and Selection Criterion

Physiological and compartmental models are valuable tools used in studying biological systems. These models rely on differential equations to maintain mass balance within the system, ensuring an accurate representation of the dynamic processes at play.
Physiological models take a detailed approach by considering specific molecular processes. They can predict drug distribution, metabolism, and elimination changes, providing a comprehensive understanding of how drugs interact with the body.
109
Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving01:29

Mechanistic Models: Compartment Models in Algorithms for Numerical Problem Solving

Mechanistic models play a crucial role in algorithms for numerical problem-solving, particularly in nonlinear mixed effects modeling (NMEM). These models aim to minimize specific objective functions by evaluating various parameter estimates, leading to the development of systematic algorithms. In some cases, linearization techniques approximate the model using linear equations.
In individual population analyses, different algorithms are employed, such as Cauchy's method, which uses a...
84