Related Experiment Videos
A lightweight ECG model with teacher-derived integrated medical semantic preservation for cardiac disease screening
Shuangquan Ma1, Wenyao Wang2, Jie Yang2
1Beijing Advanced Innovation Centre for Biomedical Engineering, School of Biological Science and Medical Engineering, Beihang University, Beijing 100083, China; Department of Cardiology and Institute of Vascular Medicine, Peking University Third Hospital, State Key Laboratory of Vascular Homeostasis and Remodeling, Peking University, Research Unit of Medical Science Research Management/Basic and Clinical Research of Metabolic Cardiovascular Diseases, Chinese Academy of Medical Sciences, Beijing Key Laboratory of Clinical Evaluation of Cardiovascular-Kidney-Metabolic and Immuno-Inflammatory Innovative Drugs and Medical Devices, No.49 Huayuanbei Road, Beijing 100191, China.
Abstract:
Recent electrocardiogram (ECG) foundation models have extended ECG analysis from rhythm and morphology recognition to cardiac structure-function assessment, but the computational and memory requirements limit their use in resource-constrained settings. This study aimed to reduce the size and inference cost of a unified ECG foundation model while retaining its multitask performance and clinically relevant representations. We developed the ECGFM-U-Lite, a compact 1D-MobileViT student, using a three-stage compression procedure. Task outputs and intermediate representations were firstly transfered from teacher through structure-function consistent distillation, redundant channels were than removed by using physiologic attention-guided pruning while retaining anatomically informative pathways, and the structure-function-aware quantization strategy achieves adaptive precise quantification by leveraging the sensitivity discrepancies across different modules finally. The model was evaluated on six locked external cohorts. Its computational profile was examined on a laptop GPU and under Android- and Jetson-Nano-oriented ONNX Runtime simulations. ECGFM-U-Lite achieved an overall AUC of 0.862, compared with 0.918 for the teacher, and retained 93.8% and 93.5% of teacher AUC for rhythm/morphology and structure/function tasks, respectively. ECG-to-Text and Text-to-ECG R@1 values were 0.766 and 0.762 in the teacher-derived semantic consistency probe. The parameter count decreased from 86.4 M to 655.7 K, model size from 345.6 MB to 1.7 MB, and peak RAM from 320 MB to 4.4 MB. The inference process was 3.6-fold faster on the laptop GPU and approximately 3.7-fold faster in the simulated edge-oriented profiles. U-Lite substantially reduces the resource requirements of a unified ECG foundation model while preserving most of its external discrimination and teacher-derived cross-modal representation structure, providing a practical basis for subsequent evaluation on resource-constrained hardware.
Related Concept Videos
Electrocardiogram
Three major waveforms are present in a typical ECG recording: the P wave, the QRS complex, and the T...
Holter Monitor: 24-Hour Monitoring