Evaluation of the expert system for respiratory therapy of newborns on archival data

The aim of this study was to evaluate the artificial ventilation expert system for neonates (AVES-N) using archival data. The recommendations of the system were compared to the decisions made by the expert-physician in the same clinical situation (patient condition, respirator settings). In our retrospective study we used data of 320 newborns which were ventilated in the Neonatal Intensive Care Unit of the Vanderbilt University Hospital in Nashville (USA). Best agreement between the recommendations of the system and the decisions of the experts was found for positive end expiratory pressure (PEEP), inspired oxygen fraction (FiO2) and peak inspiratory pressure (PIP)--about 70%. Worse agreement was found for time related parameters: respiratory frequency (f) - 54%, time of inspiration (ti) - 46%, time of next blood gas analysis - 15%. The expert system advised lower FiO2 PEEP and f. The differences were smaller in a group of patients who survived than in a group of patients who died. The overall agreement of the AVES-N advice and real therapeutic actions leads to the clinical evaluation of the expert system. The differences can be attributed to a) different therapeutic strategies at 2 NICU's, b) missing data regarding complications in the data base which were not taken into account by the expert system.