Inter- and intra-rater reliability in fibroptic endoscopic evaluation of swallowing

Fibroptic endoscopic evaluation of swallowing (FEES) is a useful way for dentists to evaluate oropharyngeal dysfunction. However, no study has paid attention to inter- and intra-rater reliability of FEES evaluation about oropharyngeal dysfunction. The purpose of this study is to verify whether dentist who trained and experienced for evaluation of dysphagia could diagnose oropharyngeal function with FEES. Nine dentists independently evaluated FEES images of 10 cases four times each. At first, evaluators performed the first evaluation without consulting the evaluative criteria. Subsequently, evaluators independently re-evaluated at 1-week intervals for three consecutive weeks, consulting the evaluative criteria. And then, inter- and intra-rater reliability was calculated. Cohen's Kappa was used to assess reliability. The results found that overall inter-rater reliability was 0·35±0·04 (first evaluation), 0·45±0·05 (s), 0·44±0·05 (third) and 0·46±0·04 (fourth). Most of inter-rater reliability related to aspiration was moderate to high, but lower for categories that evaluated timing of swallowing and mastication. In contrast, intra-rater reliability was moderate to high for overall categories, at 0·53±0·04 (first vs. second evaluation), 0·55±0·04 (first vs. third), 0·53±0·04 (first vs. fourth), 0·55±0·03 (second vs. third), 0·60±0·03 (second vs. fourth) and 0·78±0·03 (third vs. fourth). FEES is reliable for experienced dentists to diagnose oropharyngeal function. Moreover, repeated evaluation with the aids of evaluative criteria is useful to improve the reliability of FEES.