Exploring Heterogeneity in Cost-Effectiveness Using Machine Learning Methods: A Case Study Using the FIRST-ABC Trial

The aim of this study was to explore heterogeneity in the cost-effectiveness of high-flow nasal cannula (HFNC) therapy compared with continuous positive airway pressure (CPAP) in children following extubation.

Using data from the FIRST-line support for Assistance in Breathing in Children (FIRST-ABC) trial, we explore heterogeneity at the individual and subgroup levels using a causal forest approach, alongside a seemingly unrelated regression (SUR) approach for comparison.

FIRST-ABC is a noninferiority randomized controlled trial (ISRCTN60048867) including children in UK paediatric intensive care units, which compared HFNC with CPAP as the first-line mode of noninvasive respiratory support.

In the step-down FIRST-ABC, 600 children clinically assessed to require noninvasive respiratory support were randomly assigned to HFNC and CPAP groups with 1:1 treatment allocation ratio. In this analysis, 118 patients were excluded because they did not consent to accessing their medical records, did not consent to follow-up questionnaire or did not receive respiratory support.

The primary outcome of this study is the incremental net monetary benefit (INB) of HFNC compared with CPAP using a willingness-to-pay threshold of £20,000 per QALY gain. INB is calculated based on total costs and quality adjusted life years (QALYs) at 6 months. The findings suggest modest heterogeneity in cost-effectiveness of HFNC compared with CPAP at the subgroup level, while greater heterogeneity is detected at the individual level.

The estimated overall INB of HFNC is smaller than the INB for patients with better baseline status suggesting that HFNC can be more cost-effective among less severely ill patients.