Machine Learning Algorithm to Perform the American Society of Anesthesiologists Physical Status Classification

The American Society of Anesthesiologists (ASA) Physical Status (PS) Classification System defines perioperative patient scores ranging from 1 to 6 (healthy to brain dead, respectively). The scoring is performed and used by physician anesthesiologists and providers to classify surgical patients based on co-morbidities and various clinical characteristics. There is potentially a variability in scoring stemming from individual biases. The biases impact the prediction of operating times, length of stay in the hospital, anesthetic management, and billing. This study's purpose was to develop an automated system to achieve reproducible scoring.

A machine learning (ML) model was trained on already assigned ASA PS scores of 12,064 patients. The ML algorithm was automatically selected by Wolfram Mathematica (Wolfram Research, Champaign, IL) and tested with retrospective records not used in training. Manual scoring was performed by the anesthesiologist as part of the standard preoperative evaluation. Intraclass correlation coefficient (ICC) in R (version 4.2.2; R Development Core Team, Vienna, Austria) was calculated to assess the consistency of scoring.

An ML model was trained on the data corresponding to 12,064 patients. Logistic regression was chosen automatically, with an accuracy of 70.3±1.0% against the training dataset. The accuracy against 1,999 patients (the test dataset) was 69.6±1.0%. The ICC for the comparison between ML and the anesthesiologists' ASA PS scores was greater than 0.4 ("fair to good").

We have shown the feasibility of applying ML to assess the ASA PS score within an oncology patient population. Though our accuracy was not very good, we feel that, as more data are mined, a valid foundation for refinement to ML will emerge.