Postdevelopment Performance and Validation of the Artificial Intelligence-Enhanced Electrocardiogram for Detection of...

We have previously applied artificial intelligence (AI) to an electrocardiogram (ECG) to detect cardiac amyloidosis (CA).

In this validation study, the authors observe the postdevelopment performance of the AI-enhanced ECG to detect CA with respect to multiple potential confounders.

Amyloid patients diagnosed after algorithm development (June 2019-January 2022) with a 12-lead ECG were identified (n = 440) and were required to have CA. A 15:1 age- and sex-matched control group was identified (n = 6,600). Area under the receiver operating characteristic (AUC) was determined for the cohort and subgroups.

The average age was 70.4 ± 10.3 years, 25.0% were female, and most patients were White (91.3%). In this validation, the AI-ECG for amyloidosis had an AUC of 0.84 (95% CI: 0.82-0.86) for the overall cohort and between amyloid subtypes, which is a slight decrease from the original study (AUC 0.91). White, Black, and patients of "other" races had similar algorithm performance (AUC >0.81) with a decreased performance for Hispanic patients (AUC 0.66). Algorithm performance shift over time was not observed. Low ECG voltage and infarct pattern exhibited high AUC (>0.90), while left ventricular hypertrophy and left bundle branch block demonstrated lesser performance (AUC 0.75 and 0.76, respectively).

The AI-ECG for the detection of CA maintained an overall strong performance with respect to patient age, sex, race, and amyloid subtype. Lower performance was noted in left bundle branch block, left ventricular hypertrophy, and ethnically diverse populations emphasizing the need for subgroup-specific validation efforts.