Hand-scoring of multiple choice questions

Although computer marking of MCQ papers is common practice and is popular because of its accuracy, speed and the fact that detailed statistical analysis can be carried out painlessly, there is still a major role for hand-scoring. A computer and computer time are not always immediately available and some form of data capture (optical mark reading or transfer of responses to punched cards) is a necessary preliminary. The use of a computer is an unnecessary extravagance when: (a) the test is a non-critical class or small-group exam (b) the papers are short (thirty questions or less) or (c) the number of candidates is small (ten or less) (d) detailed statistical analysis is unnecessary. One-from-five MCQs can be marked by hand easily and rapidly. Multiple true/false questions are most easily hand-scored using grid response sheets and some form of stencil overlays prepared from the answer key. For multiple true/false questions the +1, -1, 0 marking system is strongly recommended. Candidates' total scores, the mean score and its standard deviation for the whole group, ranked order and histograms of scores can be obtained with little difficulty. Mean scores and standard deviations for questions take more time to calculate, but when these are available simple indices of discrimination and of internal reliability can be estimated with some extra time and trouble, although examiners may not wish to assess the discriminatory ability of every question. Hand-scoring is of greatest value in non-critical tests when candidate scores are needed rapidly and is particularly useful when combined with full feedback discussion of the MCQ paper.