Inter-rater reliability of the neurological examination in schizophrenia

Neurological Examination Abnormalities (NEA) are prevalent in schizophrenia, but the significance of this is obscured by methodological problems. The Neurological Evaluation Scale (NES), the most widely used structured neurological examination in schizophrenia research, has had limited study of its inter-rater reliability (IRR). An augmented version of the NES was jointly administered (one examiner-rater and one observer-rater) by three pairs of psychiatrists to two populations of patients with idiopathic psychotic disorders. In addition to the ordinal and categorical data yielded by the original NES, continuous data were recorded in one of the series. Reliability analyses of our populations and a previously published study, reveal consistently adequate IRR in 12 of the 26 items assessed, and inconsistently adequate IRR in an additional 11. Consistent with studies using other NEA schedules, IRR was unacceptably low for some items that rely on subjective severity ratings. Certain rare abnormalities, which posed difficulties for the estimation of IRR, are probably not generally useful in the study of schizophrenia. Reliability estimates of continuous, ordinal and dichotomous data were comparable in most cases. We recommend that certain items from the NES be deleted, and that other studies of NEA in psychiatry follow similar procedures before undertaking further analyses.