Inter-observer variability in APACHE II scoring: effect of strict guidelines and training
Related Experiment Videos
K H Polderman1, E M Jorna, A R Girbes
1Surgical Intensive Care Unit, University Hospital Vrije Universiteit, P.O. Box 7057, 1007 MB Amsterdam, The Netherlands. k.polderman@azvu.nl
Objective:
To assess the effect of strict guidelines and a rigorous training program on variability in scoring the revised Acute Physiology and Chronic Health Evaluation (APACHE II).
Design And Setting:
Prospective survey and intervention in the surgical ICU of a university teaching hospital.
Measurements:
Seven experienced intensivists and nine residents determined APACHE II scores in one set of patients before and in another set 4 months after a rigorous training program, following strict guidelines for using the APACHE II.
Results:
APACHE II scores were 14.3+/-4.4 before the training program (n=12) and 18.9+/-2.4 after (n=11). Interobserver agreement rates increased significantly from 59.7% to 76.5% and the interobserver reliability coefficient (weighted kappa) from 0.72 to 0.85 after our training program was implemented. The changes were significantly greater in experienced intensivists than in less experienced residents, indicating that more experienced physicians profited to a greater degree from our training program.
Conclusion:
Interobserver variability in APACHE II scoring decreases markedly when strict guidelines and a regular training program are implemented, particularly among more experienced physicians. However, in our study a degree of variability (10-15%) persisted even in experienced intensivists with similar training, experience, and background, suggesting that a degree of variability is inherent in APACHE II scoring.
Related Concept Videos
SBAR II: Application of SBAR
SBAR Report from a Nurse to a Health Care Provider
S: "Hello, Dr. Smith. This is Jane, RN, from the Med Surg unit. I am calling to tell you about Ms. White in Room 210, who is experiencing increased pain and redness at her incision site. Her recent...
Blind Procedures
Variability: Analysis
The range is a simple measure of variability, indicating the difference between the highest and...
Actor-Observer Effect
Standard Deviation of Calculated Results
A broad Gaussian distribution curve has a wider standard deviation, representing a data set with...
Systematic Error: Methodological and Sampling Errors
Sampling errors originate from improper sampling methods or the wrong sample population. These errors can be minimized by refining the sampling strategy. Defective instruments or faulty calibrations are the sources of instrumental...