Interobserver agreement in defecography--an international study

Defecography is considered to be an essential investigation in the evaluation of functional anorectal disorders, but the agreement between observers from different clinical centers has never been evaluated.

14 defecographic studies were selected aimed to cover the most relevant defecographic findings responsible for disordered defecation. Eight studies were considered unequivocal, but six were thought to be controversial. All were sent to the ten participants in Europe and the US (five proctosurgeons, three radiologists, two gastroenterologists). They evaluated the studies using a previously agreed upon questionnaire. Interobserver agreement was quantified by kappa statistics and by the proportions of positive and negative agreement as compared to chance agreement, respectively.

Overall, only the completeness of rectal emptying and the presence of a rectocele achieved acceptable kappa values above 0.4. When restricting the evaluation to the studies considered to be unequivocal, agreement improved considerably and was moderate to good for all items describing the images (kappa 0.43-0.63). However, whether proctosurgery should be performed and whether defecography contributed to the management of the particular patient remained controversial with very low kappa.

It is doubtful whether defecography contributes substantially to the management of patients with disordered defecation.