Related Experiment Video
Updated: Oct 11, 2025

A Swin Transformer-Based Model for Thyroid Nodule Detection in Ultrasound Images
Published on: April 21, 2023
Robust wave-feature adaptive heartbeat classification based on self-attention mechanism using a transformer model.
Shuaicong Hu1, Wenjie Cai1, Tijie Gao1
1School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, People's Republic of China.
This study introduces an advanced transformer neural network for accurate electrocardiogram (ECG) heartbeat classification, achieving high F1 scores for supraventricular and ventricular ectopic beats. This method offers a novel solution for real-time cardiovascular disease screening using wearable devices.
Area of Science:
- Cardiology
- Artificial Intelligence
- Biomedical Engineering
Background:
- Electrocardiography (ECG) is crucial for cardiovascular disease screening.
- Accurate heartbeat classification is vital for diagnosis and research.
- Existing methods require improvement for real-time applications.
Purpose of the Study:
- To develop an automatic heartbeat classification method using a transformer neural network with a self-attention mechanism.
- To enhance the accuracy and efficiency of ECG analysis for cardiovascular disease detection.
Main Methods:
- An adaptive heartbeat segmentation technique was employed to focus on time-dependent heartbeat representations.
- A 1D convolution layer embedded wave characteristics into symbolic representations.
- A transformer block with multi-head attention processed wave-embedding dependencies.
- The model was trained and fine-tuned using the MIT-BIH arrhythmia database (MIT-DB) and MIT-BIH supraventricular arrhythmia database (MIT-SVDB).
Main Results:
- The method achieved F1 scores of 0.86 for supraventricular ectopic beats and 0.96 for ventricular ectopic beats in the first group.
- An average F1 value of 99.83% was achieved in the second group, outperforming state-of-the-art methods.
- The transformer-based approach demonstrated superior performance in heartbeat classification.
Conclusions:
- A novel and effective transformer-based method for automatic heartbeat classification was proposed.
- This approach offers a promising solution for real-time ECG analysis and cardiovascular disease screening.
- The method is suitable for integration into wearable devices for continuous health monitoring.
Related Concept Videos
Classification of Signals
A continuous-time signal holds a value at every instant in time, representing information seamlessly. In contrast, a discrete-time signal holds values only at specific moments, often denoted as x(n), where...
Types Of Transformers
If the ratio of the number of turns in the secondary winding to that of the primary winding is greater than one, then the transformer is said to be a step-up transformer. In a step-up transformer, the voltage at the secondary winding is greater than the voltage applied at the primary winding.
However, if this ratio is less than one, the transformer is said to be a step-down...
Force Classification
Contact and non-contact forces are two of the most widely used categories of forces. As the name suggests, contact forces require physical contact between two objects to act upon each other. Examples of contact forces include frictional,...
The Ideal Transformer
Ampere's Law forms the basis of understanding the magnetic field within the transformer. It states that the integral of the magnetic field intensity's...
Pulse rhythm
Conversely, an irregular pulse pattern is termed dysrhythmia, stemming from disruptions in cardiac...
Aggregates Classification
Petrographic classification groups aggregates based on common mineralogical characteristics. Some of the common mineral groups found in aggregates are...
