Time-interval measurement of stuttering: modifying interjudge agreement

This paper reports the results of two experiments that investigated interval-by-interval inter- and intrajudge agreement for stuttered and nonstuttered speech intervals (4.0 sec). The first experiment demonstrated that interval-by-interval interjudge agreement could be significantly improved, and to satisfactory levels, by training judges to discriminate between experimenter-agreed intervals of stuttered and nonstuttered speech. The findings also showed that, independent of training, judges with relatively high intrajudge agreement also showed relatively higher interjudge agreement. The second experiment showed that interval-by-interval interjudge agreement was not significantly different if judges rated 4-sec speech intervals from different samples under three conditions: in random order, separated by 5-sec recording intervals; in correct order, also separated by 5-sec recording intervals; or after brief judgment signals that occurred every 4 sec during continuous samples. The implications of these findings for stuttering measurement are discussed.