Related Experiment Video
Updated: Feb 15, 2026
Flexible Colonoscopy in Mice to Evaluate the Severity of Colitis and Colorectal Tumors Using a Validated Endoscopic Scoring System
Published on: October 16, 2013
Complication Severity Score for Growth-friendly Surgery Has Strong Interrater and Intrarater Agreement
Nicole Michael1, Claire Palmer2, John T Smith3
1Children's Hospital Colorado.
Insights
The Complication Severity Score for growth-friendly surgery demonstrates strong reliability among raters. This validated system standardizes complication reporting for growing spine surgery, improving research consistency.
Area of Science:
- Spine Surgery
- Orthopedic Research
- Surgical Complications
Background:
- Growth-friendly surgery techniques for early onset scoliosis are advancing rapidly.
- High complication rates necessitate standardized reporting methods.
- A Complication Severity Score was developed to ensure consistency in research.
Purpose of the Study:
- To evaluate the interrater and intrarater reliability of the Complication Severity Score for growth-friendly surgery.
- To determine if the classification system is a dependable tool for reporting surgical complications.
Main Methods:
- A random sample of 63 early onset scoliosis cases was selected from a prospectively collected database.
- An internet survey was administered to 20 faculty and research coordinators involved in early onset scoliosis research, twice over 3 weeks.
- Fleiss Kappa and Cohen Kappa statistics were used to assess interrater and intrarater agreement, respectively.
Main Results:
- Overall interrater agreement (Fleiss Kappa) was substantial at 0.86.
- Almost perfect agreement was observed for most complication categories (e.g., Disease I: 0.91, Device IIB: 0.92).
- Intrarater agreement was also high, with an overall Cohen Kappa of 0.86.
Conclusions:
- The Complication Severity Score exhibits strong interrater and intrarater reliability.
- The classification system is a reliable tool for standardizing complication reports in growth-friendly surgery.
- Adoption of this system is recommended to enable consistent comparison of complications across different treatment modalities.
Background:
Growth-friendly surgery has high complication rates. The Complication Severity Score for growth-friendly surgery was developed to maintain consistency while reporting complications as part of research in this rapidly evolving field. This study evaluates the interrater and intrarater reliability of this complication classification system.
Methods:
After Institutional Review Board approval, complications during treatment for early onset scoliosis were identified from a prospectively collected database. Previous validation studies and a 10-case pilot survey determined that 60 cases were needed to represent a minimum of substantial agreement. In total, 63 of 496 cases were selected randomly to evenly represent each severity classification. The cases comprised an internet survey for classification sent to faculty and research coordinators involved in early onset scoliosis research, 3 weeks apart, with questions shuffled between iterations. Fleiss Kappa and Cohen Kappa were used to assess interrater and intrarater agreement, respectively.
Results:
A total of 20 participants, 12 faculty and 8 research assistants, completed the survey twice. The overall Fleiss Kappa coefficient for interrater agreement from the second round of the survey was 0.86 (95% confidence interval, 0.86-87), which represents substantial agreement. Reviewers agreed almost perfectly on categorizing complications as Device I (0.85), Disease I (0.91), Disease II (0.94), Device IIB (0.92), and Disease IV (0.98). There was substantial agreement for categorizing Device IIA (0.73) and Device III (0.76) complications. Disease III and Device IV were not evaluated in this survey since none of these occurred in the database. There was almost perfect intrarater agreement among faculty (0.87), research coordinators (0.85), and overall (0.86).
Conclusions:
There is strong interrater and intrarater agreement for the published complications classification scheme for growing spine surgery. The complication classification system is a reliable tool for standardizing reports of complications with growth-friendly surgery. Adoption of this classification when reporting on growth-friendly surgery is recommended to allow for comparison of complications between treatment modalities.
Level Of Evidence:
Level I-diagnostic study.
Related Concept Videos
02:28Titration Calculations: Strong Acid - Strong Base
A titration is carried out for 25.00 mL of 0.100 M HCl (strong acid) with 0.100 M of a strong base NaOH. The pH at different volumes of added base solution can be calculated as follows:
(a) Titrant volume = 0 mL. The solution pH is due to the acid ionization of HCl. Because this is a strong acid, the ionization is complete and the hydronium ion molarity is 0.100 M. The pH of the solution is then:
03:22Strong Acid and Base Solutions
01:23Titration of a Strong Acid with a Strong Base
01:06Introduction to z Scores
z scores...
01:05Introduction to z Scores
z scores...
01:17z Scores and Area Under the Curve