Evaluating a computer-based experiential learning simulation: a case study using criterion-referenced testing

A case study of a computer-based experiential learning program involving the use of criterion-referenced testing as a quantitative evaluation tool is described. The simulation was designed to introduce nurses to basic computer operations. One hundred and thirty-eight nurses participated in the evaluation using a specially prepared version of the program that recorded the time required to perform actions, the number of unsuccessful attempts to complete instructions, and the number of correct responses to specific questions. The ability of the nurses to "drag and drop" increased significantly from less than 20% to more than 90% (p < .05, Student's t-test). Their knowledge of the definitions of four computer-related terms (i.e., trackball, desktop, window, and icon) increased significantly (from 65% to 80%, p < .1). In subjective evaluations, 82% of respondents reported that they enjoyed the lesson and 89% wanted more computer-based instructional units to be developed. Use of criterion-referenced testing helped to shed new light on the utility of such computer aided instructional systems.