Deep learning for atrioventricular regurgitation diagnosis: an external validation study

Mitral and tricuspid regurgitation (MR and TR) are common in older adults and associated with substantial morbidity and mortality. While transthoracic echocardiography (TTE) is the diagnostic gold standard, access remains limited in many care settings. Artificial intelligence (AI)-based echocardiographic analysis may help address this diagnostic gap.

We externally validated a deep learning algorithm developed by Aisap.ai using TTE studies from the Mayo Clinic Health System (2013-23). The model analyses echocardiographic images to classify atrioventricular regurgitation severity and was evaluated against cardiologist interpretations. Performance was assessed using binary (normal-mild vs. moderate-severe) and ordinal (normal, mild, moderate, severe) classification schemes. Among 1541 eligible TTEs, the model returned predictions for 578 studies (38%). Performance analysis was limited to these cases. The MR cohort included 280 studies and the TR cohort 298. For MR, the model achieved an area under the receiver operating characteristic curve (AUC) of 0.98 [95% confidence interval (CI): 0.97-0.99], with 91% accuracy, 95% sensitivity, and 89% specificity. For TR, the AUC was 0.96 (95% CI: 0.94-0.98), with 84% accuracy, 91% sensitivity, and 80% specificity.

In cases where a prediction was generated, the model demonstrated high diagnostic performance in identifying clinically significant atrioventricular regurgitation. These findings support the feasibility of AI-assisted echocardiography in diverse populations, while underscoring the need for technical alignment between model requirements and local acquisition practices to ensure real-world applicability.