Quality Assessment of Clinical Practice Guidelines for Respiratory Diseases in China: A Systematic Appraisal

There has been a significant increase in the publication of clinical practice guidelines (CPGs) for respiratory diseases in China. However, little is known about the quality and potential impacts of these CPGs. Our objective was to critically evaluate the quality of Chinese CPGs for respiratory diseases that were published in peer-reviewed medical journals.

A systematic search of scientific literature published between 1979 and 2013 was undertaken to identify and select CPGs that were related to respiratory diseases. Four Chinese databases (the Chinese Biomedical Literature database [CBM], the China National Knowledge Infrastructure [CNKI], the VIP database, and the WANFANG database) were used. The quality of eligible guidelines was assessed independently by four reviewers using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument. The overall agreement among reviewers was evaluated using an intraclass correlation coefficient.

A total of 109 guidelines published in 27 medical journals from 1979 to 2013 were evaluated. The overall agreement among reviewers was considered good (intraclass correlation coefficient, 0.838; 95% CI, 0.812-0.862). The scores of the six AGREE domains were low: 57.3% for scope and purpose (range, 4.2%-80.5%), 23.8% for stakeholder involvement (range, 2.8%-54.2%), 7.7% for rigor of development (range, 0%-27.1%), 59.8% for clarity and presentation (range, 22.2%-80.6%), 10.9% for applicability (range, 0%-22.9%), and 0.6% for editorial independence (range, 0%-16.7%). Scores for all guidelines were below 60%, and only three guidelines (2.8%) were recommended for clinical practice with modifications.

The quality of the guidelines was low, and stakeholder involvement, rigor of development, applicability, and editorial independence should be considered in the future development of CPGs for respiratory diseases in China.