Inter-Rater Agreement of the Classification of Intraoperative Adverse Events (ClassIntra) in Abdominal Surgery

Adverse events in surgical patients can occur preoperatively, intraoperatively, and postoperatively. Universally accepted classification systems are not yet available for intraoperative adverse events (iAEs). ClassIntra has recently been developed and validated as a tool for grading iAEs that occur between skin incision and skin closure irrespective of the origin, that is, surgery, anesthesia, or organizational. The aim of this study is to assess the inter-rater agreement of ClassIntra and assess its predictive value for postoperative complications in elective abdominal surgery.

This study is a secondary use of data from the LAParotomy or LAParoscopy and ADhesiolysis (LAPAD) study, with detailed data on incidence and management of intra-operative and post-operative complications. Data were collected in a cohort of elective abdominal surgeries. Two teams graded all recorded events in the LAPAD study according to ClassIntra. Cohen Kappa coefficient was calculated to determine inter-rater agreement. Uni- and multivariable linear regression was used to assess the predictive value of the ClassIntra grades for postoperative complications.

IAEs were rated in 333 of 755 (44%) surgeries by team 1, and in 324 of 755 (43%) surgeries by team 2. Cohen kappa coefficient for ClassIntra grades was 0.87 [95% confidence interval (CI) 0.84-0.90]. Discrepancies in grading were most frequent for intraoperative bleeding and adhesions' associated injuries. At least 1 postoperative complication was observed in 278 (37%) patients. The risk of a postoperative complications increased with every increase in severity grade of ClassIntra. Intraoperative hypotension [mean difference (MD) 23.41, 95% CI 12.93-33.90] and other organ injuries (MD 18.90, 95% CI -4.22 - 42.02) were the strongest predictors for postoperative complications.

ClassIntra has an almost perfect inter-rater agreement for the classification of iAEs. An increasing grade of ClassIntra was associated with a higher incidence of postoperative complications. Discrepancies in grading related to common complications in abdominal procedures mostly consisted of intraoperative bleeding and adhesion-related injuries. Grading of interoperative events in abdominal surgery might further improve by consensus regarding the definitions of a number of frequent events.