Evaluating Guidelines: A Review of Key Quality Criteria

Guidelines of high methodological quality make an essential contribution to the quality assurance of medical knowledge. The detailed evaluation of guideline quality is a complex and time-consuming task. The answers to a few key questions generally suffice for an initial, rapid assessment of the quality and utility of a guideline.

We selectively searched the pertinent literature for guideline-assessing instruments and analyzed selected ones with respect to their target group, purpose, orientation, and comprehensiveness. We identified key questions from brief instruments that can be used to assess guideline quality rapidly.

A comparison of ten instruments revealed that most were designed to provide a highly detailed assessment of guideline quality. Four recently developed instruments enable a rough and rapid assessment. They focus, in essence, on four key questions: Was the evidence analyzed systematically? Does the evidence support the recommendations? Is the goal of the guideline formulated, and are the authors named? Is the organization of the guideline easy to follow, and are the recommendations clearly signposted?

Alongside the comprehensive instruments for assessing guidelines, such as DELBI and AGREE II, rapid-assessment instruments are a convenient tool for gaining a quick impression of the value of a guideline.