Assessment of the AAOS guidelines using the AGREE II instrument: An update

The American Academy of Orthopaedic Surgeons (AAOS) provides clinical guidelines and frequently updates and expands on the recommendations. High quality, up-to-date, and applicable clinical guidelines are increasingly important tools for physicians to have. Assessing these continuously updating guidelines' overall quality has most recently been done in 2013 when there were 14 guidelines. Since then, nearly all guidelines have been updated and now 28 guidelines are provided. Our goal was to evaluate the updated 2023 AAOS guidelines using the well-established Advancing Guideline Development, Reporting and Evaluation in Health Care (AGREE II) tool.

On April 23, 2023, all 28 guidelines set forth by AAOS were compiled. Using the AGREE II tool, a well-recognized and established tool for evaluation of guideline quality used across all disciplines, three independent reviewers appraised the current guidelines. These data were used to run descriptive statistics and assessed accordingly.

Across the 28 guidelines, the average AGREE II domain scores were as follows: Scope and Purpose (median score, 85%), Stakeholder Involvement (median score, 87%), Rigor of Development (median score, 87%), Clarity of Presentation (median score, 87%), Applicability (median score, 48%), Editorial Independence (median score, 87%), and Overall Assessment (median score, 80s%).

Five of the six AGREE II domains, including the overall assessment, tested achieved a median score above the 50% mark. These results indicate that the AAOS guidelines met many criteria for high quality based on a critical appraisal.