Using Artificial Intelligence to Adjudicate Major Adverse Cardiovascular Events in Clinical Trials

Major adverse cardiovascular events (MACE)-cardiovascular (CV) death, nonfatal myocardial infarction (MI), and nonfatal stroke-are highly relevant clinical outcomes. In global randomized trials, medical records review by a physician clinical events committee (CEC) is the conventional standard for adjudicating MACE but is labor intensive. Automated adjudication with the use of artificial intelligence (AI) could reduce cost and improve reproducibility.

In this study, the authors sought to develop and validate an AI-based adjudication system for MACE and compare its performance with CEC adjudication in a large global randomized trial.

We developed an AI-based system ("Auto-MACE") that uses an iteratively refined prompt of the OpenAI o1-mini language model to adjudicate MACE events, and a Clinical Longformer model trained on adjudicated events to assign a confidence level. We validated Auto-MACE against CEC adjudication in the PARADISE-MI global clinical trial comparing sacubitril/valsartan and ramipril in 5,661 patients with MI complicated by systolic dysfunction or pulmonary congestion.

Auto-MACE provided a confident adjudication in 315/455 deaths (69%), 301/659 potential MIs (46%), and 136/167 potential strokes (81%). Auto-MACE agreed with the CEC adjudication in 97%, 89%, and 88% of confident events, respectively. Among all events, Auto-MACE agreed with CEC adjudications in 86% of deaths, 76% of potential MIs, and 84% of potential strokes. The estimated effect of sacubitril/valsartan vs ramipril on composite MACE was similar with Auto-MACE adjudication (HR: 0.91; 95% CI: 0.78-1.07) and CEC adjudication (HR: 0.90; 95% CI: 0.77-1.05).

AI-based adjudication of MACE showed high agreement with human CEC adjudication, especially for CV death and stroke, and where the model was confident. Initial AI-based adjudication with CEC review of uncertain events may reduce workload while maintaining accuracy.